-- Logs begin at Wed 2022-08-17 18:26:35 UTC, end at Wed 2022-08-17 19:45:05 UTC. -- Aug 17 19:12:17.021923 dv-cinder-850698-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 19:12:17.030653 dv-cinder-850698-2-smb devstack@keystone.service[81662]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:12:17 2022] *** Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: nodename: dv-cinder-850698-2-smb Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: machine: x86_64 Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: clock source: unix Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: pcre jit disabled Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: detected number of CPU cores: 4 Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: current working directory: / Aug 17 19:12:17.033175 dv-cinder-850698-2-smb devstack@keystone.service[81662]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: your processes number limit is 47680 Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: your memory page size is 4096 bytes Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: detected max file descriptor number: 2048 Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: lock engine: pthread robust mutexes Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: thunder lock: enabled Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 19:12:17.033696 dv-cinder-850698-2-smb devstack@keystone.service[81662]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:12:17.074181 dv-cinder-850698-2-smb devstack@keystone.service[81662]: Python main interpreter initialized at 0x55d5c98389c0 Aug 17 19:12:17.074181 dv-cinder-850698-2-smb devstack@keystone.service[81662]: python threads support enabled Aug 17 19:12:17.074181 dv-cinder-850698-2-smb devstack@keystone.service[81662]: your server socket listen backlog is limited to 100 connections Aug 17 19:12:17.074181 dv-cinder-850698-2-smb devstack@keystone.service[81662]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:12:17.074524 dv-cinder-850698-2-smb devstack@keystone.service[81662]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:12:17.074603 dv-cinder-850698-2-smb devstack@keystone.service[81662]: *** Operational MODE: preforking *** Aug 17 19:12:17.074865 dv-cinder-850698-2-smb devstack@keystone.service[81662]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:12:17.074865 dv-cinder-850698-2-smb devstack@keystone.service[81662]: spawned uWSGI master process (pid: 81662) Aug 17 19:12:17.075062 dv-cinder-850698-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 17 19:12:17.075606 dv-cinder-850698-2-smb devstack@keystone.service[81662]: spawned uWSGI worker 1 (pid: 81674, cores: 1) Aug 17 19:12:17.075935 dv-cinder-850698-2-smb devstack@keystone.service[81662]: spawned uWSGI worker 2 (pid: 81675, cores: 1) Aug 17 19:12:17.077036 dv-cinder-850698-2-smb devstack@keystone.service[81662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:12:21.499101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:12:21.499101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: from cryptography.utils import int_from_bytes Aug 17 19:12:21.499889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:12:21.499889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: from cryptography.utils import int_from_bytes Aug 17 19:12:21.553195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:12:21.553395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:12:21.553590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] command line args: [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:12:21.553864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:12:21.554046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ================================================================================ {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:12:21.554302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] admin_token = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.554550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] config_dir = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.554738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.554923 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] config_source = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.555103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] debug = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.555305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.556716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.556716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.556716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.556716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.556716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.556716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_config_append = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.557143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.557143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_dir = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.557266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_file = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.557463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.557713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.557959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.558204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.558382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.558560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.558804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.559048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.559282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.559512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.559744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.559976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.560219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.561210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.561210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.561350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.561505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] publish_errors = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.561696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.561928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.562109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.562360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.562598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.562836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] standard_threads = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.563105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.563370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.563526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.563844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] use_journal = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.564024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] use_json = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.564200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] use_stderr = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.564407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] use_syslog = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.564663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.564908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.565151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.565415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.565655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.565905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.566144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.566393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.566631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.566879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.567128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.567379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.567615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.567864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.568104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.568386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.568637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.568876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.569131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.569425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.569676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.569916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.570203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.570468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.570729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.570980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.571214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.571446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.571695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.571933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.572223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.572586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.572823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.573058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.573308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.573558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.573824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.574225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.574541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.574913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.575265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.575609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.575956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.576350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.576639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.576969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.577359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.577666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.577909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.578412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.579191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.579592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.579941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.580070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.580332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.580575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.580811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.581049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.581292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.581524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.581776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.582014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.582256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.582490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.582755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.582995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.583231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.583470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.583708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.583979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.584219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.584493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.584741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.584979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.585218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.585455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.585705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.585944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.586183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.586473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.586869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.587255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.587638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.587996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.588357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.588749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.589123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.589487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.589863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.590238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.590607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.590952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.591303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.591652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.592017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.592423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.592811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.593190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.593582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.593952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.595016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.595506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.595783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.596203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.596611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.597047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.external = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.597483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.598000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.598392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.598650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.password = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.598894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] auth.token = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.599241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.599700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.600021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.600300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.600677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.601015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.601420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.601858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.602311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.602772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.603070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.603324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.603582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.603830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.604095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.604396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.604644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.604905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.605197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.605450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.605719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.605964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.606226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.606465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.606706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.606955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.607205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.607440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.607689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.607929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.608184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.608450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.608709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.608948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.609196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.609434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.609685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.609966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.610204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.610598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.610889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.611126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.611369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.611622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.611876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.612110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.612437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.612671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.612920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.613167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.613415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.613670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.613918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.614189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.614427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.614664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.614901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.615138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.616798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.617205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.617264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.617646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.617897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.618131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.618370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.618601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.618841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.619078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.619325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.619563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.619799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.620051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.620325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.620561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.620795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.621046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.621296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.621538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.621783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.622014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.622246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.622487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.622749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.622983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.623230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.623478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.623723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.623960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.624190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.624456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.624693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.624929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.625161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.625407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.625785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.626193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.626307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.626556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.626789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.627039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.627277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.627513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.627750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.627984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.628229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.628501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.628739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.628993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.629223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.629467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.629703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.629940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.630177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.630423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.630795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.630934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.631169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.631416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.631665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.631937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.632174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.632446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.632697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.632933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.633177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.633888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.633888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] role.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] role.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.638340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.643632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.644790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.645047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.645170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.connection = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.649675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.650980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.651226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.651464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.651712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.651952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.652195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.652463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.652705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.652943 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.653114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:12:21.671483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:12:21.671483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: from cryptography.utils import int_from_bytes Aug 17 19:12:21.672038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:12:21.672038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: from cryptography.utils import int_from_bytes Aug 17 19:12:21.690007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.690230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.690456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.699019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.720841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:12:21.721026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:12:21.721218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] command line args: [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:12:21.721487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:12:21.721663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ================================================================================ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:12:21.721917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] admin_token = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.722161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_dir = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.722348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.722531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_source = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.722710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] debug = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.722924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.723160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.723337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.723585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.723829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.724057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.724236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_config_append = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.724436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.724611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_dir = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.724786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.725019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.725264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.725508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.725792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.725935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.726111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.726353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.726593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.726821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.727049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.727234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.727315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.727469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.727560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.727731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.727973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.728257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.728755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.728935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] publish_errors = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.729162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.729390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.729566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.729808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.730037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.730269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] standard_threads = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.730498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.730739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.730914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.731089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_journal = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.731263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_json = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.731436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_stderr = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.731609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_syslog = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.731839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:12:21.732092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.732351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.732610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.732846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.733091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.733325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.733570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.733803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.734049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.734293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.734541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.734811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.735579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.735817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.736071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.736395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.736649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.736906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.737161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.737406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.737643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.737896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.738156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.738412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.738659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.738888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.739128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.739340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.739574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.739822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.740066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.740321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.740553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.740797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.741043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.741279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.741525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.741776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.741990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.742234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.742462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.742690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.742920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.743148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.743383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.743628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.743857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.744090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.744342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.744578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.744812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.745057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.745286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.745521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.745754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.745987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.746219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.746450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.746676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.746923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.747156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.747393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.747623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.747881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.748116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.748376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.748612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.748848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.749173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.749352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.749597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.749842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.750077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.750313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.751179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.751443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.751683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.751919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.752162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.752423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.752660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.752896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.753133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.753368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.753628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.753871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.754154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.754409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.754652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.754887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.755120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.755354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.755583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.755813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.756043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.756301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.756535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.756776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.757010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.757257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.757494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.757749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.758010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.758256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.758487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.external = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.758717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.759012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.759244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.759474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.password = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.759705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.token = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.759941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.760175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.760444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.760673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.760919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.761164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.761393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.761627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.761873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.762121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.762366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.762600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.762841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.763075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.763336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.763587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.763822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.764074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.764376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.764622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.764883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.765123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.765377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.765611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.765845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.766133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.766421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.766651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.766898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.767134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.767391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.767621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.767874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.768115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.768392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.768629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.768875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.769121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.769357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.769593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.769839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.770068 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.770303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.770552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.770802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.771032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.771262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.771491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.771734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.771979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.772224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.772522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.772769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.773039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.773275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.773511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.773742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.773978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.774208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.774443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.774682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.774920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.775167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.775397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.775642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.775886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.776119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.776389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.776636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.776867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.777103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.777332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.777570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.777805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.778086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.778288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.778523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.778770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.779016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.779246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.779474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.779720 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.779966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.780200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.780457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.780693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.780922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.781163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.781548 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.781930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.782161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.782416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.782662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.782901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.783131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.783368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.783603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.783840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.784071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.784337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.784418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.784584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.784863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.785070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.785313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.785542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.785785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.786019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.786252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.786484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.786716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.786959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.787205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.787440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.787692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.787926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.788184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.788432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.788670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.788904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.789148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.789388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.789618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.789851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.790095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.790402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.790647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.790881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.791132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.791380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.791618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.791860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.792094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.792356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.792591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.792835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.793066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.793312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.793560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.793807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.794052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.794295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.794537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.794779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.795022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.795251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.795495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.795738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.795982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.796224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.796669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.796903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.797151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.797984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.798287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.798545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.798778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.799033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.799285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.799524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.799756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.799989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.800220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.800504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.800762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.801007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.801243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.801477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.801705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.801940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.802173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.802418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.802653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.802906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.803151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.803388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.803630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.803873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.804119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.804374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.804612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.804848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.805093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.805340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.805567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.805809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.806126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.806385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.806626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.806872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.807107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.807348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.807582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.807815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.808049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.808311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.808556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.808789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.809030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.809264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.809509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.809740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.809980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.810206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.810444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.810675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:12:21.810892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:12:21.836035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.836279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.836505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.845275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.848204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.848466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.863752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.863977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.901523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.938867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:21.939067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.012799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.013082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.013413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.013693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.013914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.014137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.040521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.040747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.040970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.041189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.041404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.041618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.041837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.054719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.069504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.069736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.069960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.070180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.070393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.070606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.070818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.071435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.071667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.071888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.072104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.072342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.072557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.085237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.085465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.085687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.085914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.086133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.086345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.086555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.087730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.087941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:12:22.088305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.088509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:12:22.088786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.089070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.089597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.089862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.094073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.097809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.098040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.098263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.098546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.098760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.098970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.099184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:12:22.101912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.102194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.102465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.102750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.109138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.109350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:12:22.109691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.109770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.110498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:12:22.110727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.110993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.111254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.111509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.113342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.113631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.113914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.114198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.114484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.114753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.115026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.115301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.115684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.115960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.116235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.121026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.121307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.121578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.121861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.129006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.131885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.132171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.132490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.132775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.133065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.133338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.133607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.133877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.134146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.134430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.134693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.138819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.140318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.140608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.145336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.145627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.145915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.152274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.152560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.156661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.157522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.157876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.157970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.158187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.158466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.158746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.159020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.159292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.159416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.159711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.164263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.164564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.164844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.171275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.171560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.176224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.176589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.176883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.177165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.177441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.177836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.178117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.178387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.179687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.180076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.183965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.187192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.187491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.192002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.195155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.195451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.195728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.198505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.198806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.199112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.199404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.199560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.199788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.200098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.202662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.202958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.207726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.210866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.214033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.214331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.214618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.215011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.215306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.215682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.221709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.222014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.222286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.222556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.229460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.230978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.231265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.232011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.232322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.232597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.232874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.233925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.234212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.234495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.234798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.235634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.240296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.241949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.242226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.244872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.245161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.245459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.245742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.246018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.247142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.247430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.247715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.247998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.248302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.248581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.248858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.257188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.257421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.257702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.257982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.258259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.258531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.258804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.266002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.269926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.272841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.274280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.275760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.275978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.276061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.276355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.278912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.282485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.283711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.283907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.285199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.285386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.285667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.285967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.288159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.288494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.288780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.289058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.292363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.293797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.296692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.297005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.297086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.297315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.297410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.297720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.297838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.304860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.305145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.305425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.305700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.305823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.305976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.306114 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.306259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.306389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.306532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.306798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.307075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.307363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.307644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.307905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.308177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.308465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.313220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:12:22.313698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.314010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.314289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.314576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.314853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.315130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.315400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.315684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.315970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.316261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.316538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.316804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.317064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:12:22.343833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d5c98389c0 pid: 81674 (default app) Aug 17 19:12:22.348448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da15496-ddb7-44b7-84d8-cae8c29c4c47 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:22.348859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da15496-ddb7-44b7-84d8-cae8c29c4c47 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:22.349158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da15496-ddb7-44b7-84d8-cae8c29c4c47 None None] PATH_INFO: `/v3` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:22.352959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d5c98389c0 pid: 81675 (default app) Aug 17 19:12:22.354775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Wed Aug 17 19:12:22 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:30.047305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:30.047888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:30.047970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:30.052185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:12:30.057316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:30.057712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:30.057866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:30.128093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: INFO dbcounter [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] Registered counter for database keystone Aug 17 19:12:30.147193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG oslo_db.sqlalchemy.engines [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:12:30.153391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writer thread running {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:12:30.332331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG passlib.handlers.bcrypt [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81674) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:12:30.332747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG passlib.handlers.bcrypt [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81674) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:12:30.386829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:30.388463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:30.518865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 19:12:30.957818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:31.034056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: INFO dbcounter [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] Registered counter for database keystone Aug 17 19:12:31.066473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG oslo_db.sqlalchemy.engines [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:12:31.073072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writer thread running {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:12:31.194605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdba03-29b6-4f02-b93c-adfb537f8518 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:31.198874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:31.199517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:31.199798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:31.200075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:31.209197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:31.260386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:12:31.260727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec142c6-df26-4fe3-bf7c-860b460858e0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:31.271118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Wed Aug 17 19:12:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:12:31.277071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:31.291318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbd3b7-ba29-403b-9ad8-40f36c6f4090 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:31.296049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:31.297681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:31.298097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:31.298377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] PATH_INFO: `/v3/projects/0fa6223fd0f04b6fb349808c655819e2` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:31.299959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0fa6223fd0f04b6fb349808c655819e2)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:31.352705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:12:31.353047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816beed-0aab-4802-a8b2-ea907dfccba0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:31.357516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Wed Aug 17 19:12:31 2022] GET /identity/v3/projects/0fa6223fd0f04b6fb349808c655819e2 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:33.234816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20269100-9d79-4a77-9eb9-41b9fde177a5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:33.235341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20269100-9d79-4a77-9eb9-41b9fde177a5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:33.235341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20269100-9d79-4a77-9eb9-41b9fde177a5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:33.239487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:12:33.244920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:33.245346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:33.245469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:33.265594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:33.267585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:33.275284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 19:12:33.548512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20269100-9d79-4a77-9eb9-41b9fde177a5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:33.560515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20269100-9d79-4a77-9eb9-41b9fde177a5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:33.564982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513be9ce-0653-4ab8-b489-6e5fe534cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:33.565582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be9ce-0653-4ab8-b489-6e5fe534cda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:33.565867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be9ce-0653-4ab8-b489-6e5fe534cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:33.566144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be9ce-0653-4ab8-b489-6e5fe534cda2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:33.573722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be9ce-0653-4ab8-b489-6e5fe534cda2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:33.575490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513be9ce-0653-4ab8-b489-6e5fe534cda2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:33.585141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Wed Aug 17 19:12:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:12:33.590368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:33.599974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704159f-3f5e-4f60-9f3c-de2ab240dc4e None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:33.604228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638917-97af-4fbe-818d-f860e4318101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:33.604872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638917-97af-4fbe-818d-f860e4318101 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:33.605151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638917-97af-4fbe-818d-f860e4318101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:33.605423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638917-97af-4fbe-818d-f860e4318101 admin admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:33.606723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd638917-97af-4fbe-818d-f860e4318101 admin admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:33.608548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd638917-97af-4fbe-818d-f860e4318101 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:33.610080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Wed Aug 17 19:12:33 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:35.591146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2461-68e4-4c5c-b3a9-4393000627fc None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:35.591688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2461-68e4-4c5c-b3a9-4393000627fc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:35.591688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2461-68e4-4c5c-b3a9-4393000627fc None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:35.593063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:35.596953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494d3c8-ff41-416b-9015-87d3d2133900 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:35.597371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494d3c8-ff41-416b-9015-87d3d2133900 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:35.597561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494d3c8-ff41-416b-9015-87d3d2133900 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:35.597917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:35.598278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:35.598590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:35.598886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:35.603789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:35.604072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:35.604382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:35.621667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:35.622839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:35.641423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG passlib.handlers.bcrypt [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81675) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:12:35.641844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG passlib.handlers.bcrypt [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81675) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:12:35.686628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:35.688915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:35.701681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:12:35.788226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:12:35.969843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:35.993942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.065019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.077009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f902f-5996-499f-a103-225fbff4d6f6 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.111128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.111743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.112020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.112319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.166578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ca83-1b0c-4a9b-a4cf-833857fa8234 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.168858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.178057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.179544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.202659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.205417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.206529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.206814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.207089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.218489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:36.227908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:36.228820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:36.229648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:36.235405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.279475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 8/15] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:12:36.285610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.335744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7506-7616-41c4-a720-eb7646d7b882 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.368030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.368665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.368954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.369234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.369905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:36.370214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.371682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.384115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 8/16] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:36.388650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90461ffd-f9ef-475c-bffc-796095258e12 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.389610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.411095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.419539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.424447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.425085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.425362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.425634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.435369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.436858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:12:36.455246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:36.456271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:12:36.457277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:12:36.457277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:12:36.457277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:36.457277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:36.462188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.494334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aad8b-ca22-4c4d-b473-d3adf7284e5d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.528489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.529125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.529408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.529684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.531192 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.532758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.534332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 9/18] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:36.539868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.565527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce7dad-7bbc-49f0-8105-83e18ee3bd54 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.599041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.599668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.599925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.600204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.600895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:36.601180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.602570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.620264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:36.633353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.642837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4172a9-ae1f-4e67-99ab-7d6f601d85ec None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.679865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6702d-4882-4818-9cb3-2259f7fd359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.680569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6702d-4882-4818-9cb3-2259f7fd359e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.680855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6702d-4882-4818-9cb3-2259f7fd359e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.681131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6702d-4882-4818-9cb3-2259f7fd359e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.682344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6702d-4882-4818-9cb3-2259f7fd359e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.683823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6702d-4882-4818-9cb3-2259f7fd359e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.685526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:36.691674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:36.727977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:36.798736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea12c3-0915-4262-b453-8050de99f475 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:36.843280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147193da-059f-49ce-8efb-498081463501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:36.844532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147193da-059f-49ce-8efb-498081463501 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:36.844818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147193da-059f-49ce-8efb-498081463501 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:36.845132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147193da-059f-49ce-8efb-498081463501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:36.845884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147193da-059f-49ce-8efb-498081463501 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.domain.id=default, user.id=a53f1ba3fed7453aacc3b6fcf0875642) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:36.846191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147193da-059f-49ce-8efb-498081463501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:36.847642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147193da-059f-49ce-8efb-498081463501 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:36.855068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 11/21] 10.222.0.62 () {56 vars in 1322 bytes} [Wed Aug 17 19:12:36 2022] GET /identity/v3/role_assignments?user.id=a53f1ba3fed7453aacc3b6fcf0875642&scope.domain.id=default&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:38.850445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdc5af-7c2c-4e9d-ae95-578bcd941b09 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:38.850445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdc5af-7c2c-4e9d-ae95-578bcd941b09 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:38.850445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdc5af-7c2c-4e9d-ae95-578bcd941b09 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:38.851596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:38.855729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db7c2-4ad7-4869-8dee-dd70b342ae72 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:38.856542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db7c2-4ad7-4869-8dee-dd70b342ae72 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:38.857027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db7c2-4ad7-4869-8dee-dd70b342ae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:38.885330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-566db7c2-4ad7-4869-8dee-dd70b342ae72 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:38.886867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-566db7c2-4ad7-4869-8dee-dd70b342ae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:38.990520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:12:39.226674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e31d7-6ed3-4cf4-abb1-f6e2c5deebd2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.227338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e31d7-6ed3-4cf4-abb1-f6e2c5deebd2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.227860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e31d7-6ed3-4cf4-abb1-f6e2c5deebd2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.229407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:39.234577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6c85-13e1-49f8-87a8-bf6d3f4aee95 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.235087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6c85-13e1-49f8-87a8-bf6d3f4aee95 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.235553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6c85-13e1-49f8-87a8-bf6d3f4aee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.261228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-809b6c85-13e1-49f8-87a8-bf6d3f4aee95 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:39.262754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-809b6c85-13e1-49f8-87a8-bf6d3f4aee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:39.288476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:39.342541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 13/25] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:39.438912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe089e-82cd-47eb-927d-f522272bcd6e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.439529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe089e-82cd-47eb-927d-f522272bcd6e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.440052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe089e-82cd-47eb-927d-f522272bcd6e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.441595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 13/26] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:39.446998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.447506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.447975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.470467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:39.472072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:39.492403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe089e-82cd-47eb-927d-f522272bcd6e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:39.620122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 14/27] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:39.681865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe089e-82cd-47eb-927d-f522272bcd6e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:39.726810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:39.727797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.728368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.728836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.753316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:39.755084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1a8badc3-aa7b-4fef-9a93-6ad2932b6075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:12:39.775818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:39.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:12:39.777802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:12:39.777802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:12:39.777802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:39.779505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 14/28] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:39.785527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:39.798930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ee064-1f51-4308-a65d-b76bcaae1f51 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.799463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ee064-1f51-4308-a65d-b76bcaae1f51 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.801409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ee064-1f51-4308-a65d-b76bcaae1f51 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.802952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 15/29] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:39.808997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:39.809467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:39.809882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:39.855135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:39.857038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:39.872551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:39.948749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:39.955146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 16/30] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:39.956459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:40.007228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c37a5-4342-4c03-a372-946e5b32c3cd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.075997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.076649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.076932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.077208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.077863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:40.078580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:40.080107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:40.101724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 15/31] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:40.102402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:40.132653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fb170-69ee-4aa7-acd4-b74238d3adac None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.196867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.197490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.197775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.198051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.198719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:40.200109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:40.278391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27494d-4dd4-43e1-9f19-673b1ad57815 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.314280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.314966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.315249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.315578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.327803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:40.334564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:40.335487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:40.336208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 16/32] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:40.336885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:40.338426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 17/33] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 17 19:12:39 2022] POST /identity/v3/roles => generated 219 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:40.342258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:40.349536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:40.353618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:40.458268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbb6ea-99d6-4a81-81e4-376e19ee7857 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.499350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a29892-644b-4fd7-ba25-bc6e788903d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.500664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29892-644b-4fd7-ba25-bc6e788903d4 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.501162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29892-644b-4fd7-ba25-bc6e788903d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.501446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a29892-644b-4fd7-ba25-bc6e788903d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.502216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a29892-644b-4fd7-ba25-bc6e788903d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:40.503725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a29892-644b-4fd7-ba25-bc6e788903d4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:40.521960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534281e5-b400-4a6c-9003-289d39166025 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.563991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.564566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.564900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.565179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.565845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:40.567341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:40.586778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 18/34] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 17 19:12:40 2022] POST /identity/v3/roles => generated 225 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:40.587610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:40.657740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 17/35] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:12:40 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:40.660182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a0edb-f9ea-4ef0-b798-daecede34bb7 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.660646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a0edb-f9ea-4ef0-b798-daecede34bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.660834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a0edb-f9ea-4ef0-b798-daecede34bb7 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.662348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 18/36] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:40.683447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:40.683644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64036-aaea-4caf-b8c7-8a15b8a1cd34 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.683857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64036-aaea-4caf-b8c7-8a15b8a1cd34 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.684099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64036-aaea-4caf-b8c7-8a15b8a1cd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.741869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a61ad6-5dc1-4945-baed-9ac46964fe9b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.790465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.791112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.791395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.791669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.792412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:40.792722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:40.794258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543edf02-fc4a-4ea2-a6da-529ad1cf5dfc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:40.805099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 19/37] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:40.807491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d578d-02b4-4413-90a5-7fec5846a7d7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.807783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d578d-02b4-4413-90a5-7fec5846a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.808058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d578d-02b4-4413-90a5-7fec5846a7d7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.809649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 20/38] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:40.817227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d578d-02b4-4413-90a5-7fec5846a7d7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:40.852465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-15a64036-aaea-4caf-b8c7-8a15b8a1cd34 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:40.854128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-15a64036-aaea-4caf-b8c7-8a15b8a1cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:40.922626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:40.937242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 19/39] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:12:40.938851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.939138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.939411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.952914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d578d-02b4-4413-90a5-7fec5846a7d7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:40.959686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:40.960912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:40.986084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:40.995082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:40.995729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:40.996009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:40.996322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:40.997458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:40.998897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:41.002711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 21/40] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:40 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:41.008174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:41.036313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 20/41] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:41.120830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6567e-7e36-4d62-a3be-587720afd11f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:41.154257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:41.154887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:41.155173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:41.155449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:41.156775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:41.158213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:41.159981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 22/42] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:41.165427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:41.201954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:41.268003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:41.280407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44e417-f544-4782-9e63-1aa946c1a7b6 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:41.302953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:41.311121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c653-bf49-43fb-a86e-f2bd648f9b5c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:41.317818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:41.318486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:41.318768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:41.319041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] PATH_INFO: `/v3/domains/default/users/a53f1ba3fed7453aacc3b6fcf0875642/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:41.321015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a53f1ba3fed7453aacc3b6fcf0875642, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:41.322689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:41.338364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 21/43] 10.222.0.62 () {58 vars in 1361 bytes} [Wed Aug 17 19:12:41 2022] PUT /identity/v3/domains/default/users/a53f1ba3fed7453aacc3b6fcf0875642/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:12:41.339167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:41.349311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:41.350194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:41.350632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:41.350914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:41.351608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:41.353064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:41.368832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 17 19:12:41 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:12:41.473815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3368-bc61-47a2-8e47-19c00a952749 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:41.518050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500fe0c-c94b-448c-9ccb-dfc5b9d01972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:41.518703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500fe0c-c94b-448c-9ccb-dfc5b9d01972 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:41.518986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500fe0c-c94b-448c-9ccb-dfc5b9d01972 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:41.519266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500fe0c-c94b-448c-9ccb-dfc5b9d01972 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:41.520418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500fe0c-c94b-448c-9ccb-dfc5b9d01972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:41.521885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500fe0c-c94b-448c-9ccb-dfc5b9d01972 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:41.523448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 22/45] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:41.529107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:41.636014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03cd93-56bd-409c-b32e-8e7a181d6c44 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:41.658235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:41.670661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4685c49-1369-4867-908b-fb22e37cf6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:41.671275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c49-1369-4867-908b-fb22e37cf6a3 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:41.671555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c49-1369-4867-908b-fb22e37cf6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:41.671914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4685c49-1369-4867-908b-fb22e37cf6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:41.672598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4685c49-1369-4867-908b-fb22e37cf6a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:41.674038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4685c49-1369-4867-908b-fb22e37cf6a3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:41.702238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:12:41 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:43.264637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9131d-8f39-40ec-a503-4b46ba09c2f3 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:43.265122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9131d-8f39-40ec-a503-4b46ba09c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:43.265122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9131d-8f39-40ec-a503-4b46ba09c2f3 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:43.267297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 23/47] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:43.272624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4313c4-9665-44cb-8146-05179501e85e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:43.273043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4313c4-9665-44cb-8146-05179501e85e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:43.273190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4313c4-9665-44cb-8146-05179501e85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:43.291716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0b4313c4-9665-44cb-8146-05179501e85e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:43.293267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0b4313c4-9665-44cb-8146-05179501e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:43.358245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 25/48] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:43.585742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3395-b452-4678-82c3-5dec1d4a5e1b None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:43.586038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3395-b452-4678-82c3-5dec1d4a5e1b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:43.586321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3395-b452-4678-82c3-5dec1d4a5e1b None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:43.587787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 24/49] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:43.593133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:43.593434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:43.594862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:43.612963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:43.614161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:43.624487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3395-b452-4678-82c3-5dec1d4a5e1b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:43.677288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:43.682940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 26/50] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:43.729576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3395-b452-4678-82c3-5dec1d4a5e1b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:43.762322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:43.762950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:43.763228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:43.763498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:43.773803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:43.778533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:43.779414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:43.780483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 25/51] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:43.785363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:43.818629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:43.886525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad131-c47d-48ce-b1f2-28963f31c81b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:43.919862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:43.920496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:43.920778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:43.921052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:43.921737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:43.922037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:43.923416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:43.931226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 27/52] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:43.936774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:43.977367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:44.046007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc780c2-50be-4174-911f-4ff2ce2b7ff9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:44.055711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:44.076995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:44.081910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:44.082545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:44.082825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:44.083097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:44.083962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4173e9f-acf3-4513-8ae1-2e6f230e7695 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:44.084214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:44.085691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:44.087448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:43 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:44.092838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:44.118437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:44.119071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:44.119355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:44.119631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:44.120789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:44.122240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:44.123963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 28/54] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:44.130072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:44.191190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4963a-39c1-4e3b-813a-e8512cac2e96 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:44.224182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:44.224838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:44.225177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:44.225457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:44.226570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:44.227429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d251d-09de-442a-abcf-362cbbc0f852 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:44.228021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:44.229930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:44.236309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:44.266797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ad04-937d-4fda-9214-eab7ecac59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:44.267412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ad04-937d-4fda-9214-eab7ecac59fc None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:44.267690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ad04-937d-4fda-9214-eab7ecac59fc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:44.267972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ad04-937d-4fda-9214-eab7ecac59fc None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:44.268697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ad04-937d-4fda-9214-eab7ecac59fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:44.270129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ad04-937d-4fda-9214-eab7ecac59fc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:44.284680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:44.296470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 29/56] 10.222.0.62 () {60 vars in 1140 bytes} [Wed Aug 17 19:12:44 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:12:44.344964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededb18-1843-4a96-b1ab-7ad74fc6a7e4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:44.383503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:44.384184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:44.384504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:44.384787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:44.385532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.domain.id=default, user.id=a53f1ba3fed7453aacc3b6fcf0875642) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:44.385844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:44.387331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54010c6-3f0d-4075-b18f-dcaf5e9538cf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:44.394707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1322 bytes} [Wed Aug 17 19:12:44 2022] GET /identity/v3/role_assignments?user.id=a53f1ba3fed7453aacc3b6fcf0875642&scope.domain.id=default&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:46.207617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30f75d-0ff6-49c4-a239-f0ef40617081 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:46.208120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30f75d-0ff6-49c4-a239-f0ef40617081 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:46.208230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30f75d-0ff6-49c4-a239-f0ef40617081 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:46.209515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 30/58] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:46.214523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:46.214930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:46.215084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:46.237767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:46.239014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:46.305877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 29/59] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:46.585533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30f75d-0ff6-49c4-a239-f0ef40617081 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:46.604972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:46.692467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30f75d-0ff6-49c4-a239-f0ef40617081 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:46.726266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09625b0e-bb6c-4503-95c1-b0e62709011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:46.726889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09625b0e-bb6c-4503-95c1-b0e62709011d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:46.727172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09625b0e-bb6c-4503-95c1-b0e62709011d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:46.727447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09625b0e-bb6c-4503-95c1-b0e62709011d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:46.728591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09625b0e-bb6c-4503-95c1-b0e62709011d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:46.730033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09625b0e-bb6c-4503-95c1-b0e62709011d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:46.731581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 31/60] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:46.737821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:46.778172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:46.837794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bf03-3fef-45a3-bbcd-64af75cdad9d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:46.870529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea088e42-8d63-4aec-94fd-775854b57fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:46.871142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088e42-8d63-4aec-94fd-775854b57fdf None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:46.871427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088e42-8d63-4aec-94fd-775854b57fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:46.871706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088e42-8d63-4aec-94fd-775854b57fdf None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:46.872402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea088e42-8d63-4aec-94fd-775854b57fdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:46.873890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea088e42-8d63-4aec-94fd-775854b57fdf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:46.905730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 30/61] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:12:46 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:49.789685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc66a-7ab4-4588-93b0-1977091ddbbb None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:49.790731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc66a-7ab4-4588-93b0-1977091ddbbb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:49.791212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc66a-7ab4-4588-93b0-1977091ddbbb None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:49.792790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 32/62] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:49.798407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff82e2-cba1-4f27-a0c1-c212c5545e17 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:49.799202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff82e2-cba1-4f27-a0c1-c212c5545e17 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:49.799691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff82e2-cba1-4f27-a0c1-c212c5545e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:49.818625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-12ff82e2-cba1-4f27-a0c1-c212c5545e17 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:49.820134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-12ff82e2-cba1-4f27-a0c1-c212c5545e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:49.889406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 31/63] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:50.120965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1954088-7b96-499a-bd88-da6a3bd8a310 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.121597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1954088-7b96-499a-bd88-da6a3bd8a310 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.122075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1954088-7b96-499a-bd88-da6a3bd8a310 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.123618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 33/64] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:50.138152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6118ea-a174-4a89-b3f3-069799036869 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.138751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6118ea-a174-4a89-b3f3-069799036869 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.139233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6118ea-a174-4a89-b3f3-069799036869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.157815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ed6118ea-a174-4a89-b3f3-069799036869 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:50.159317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ed6118ea-a174-4a89-b3f3-069799036869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:50.178548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:50.214198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1954088-7b96-499a-bd88-da6a3bd8a310 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:50.271014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 32/65] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:50.272641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2dd4c-f795-45cc-801d-82697f9acd9b None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.273131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2dd4c-f795-45cc-801d-82697f9acd9b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.273600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2dd4c-f795-45cc-801d-82697f9acd9b None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.275404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 33/66] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:50.281986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.282421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.282841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.323986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:50.325249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:50.353546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:50.387327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1954088-7b96-499a-bd88-da6a3bd8a310 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:50.456661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:50.457308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.457587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.457860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.470456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 34/67] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:50.476671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:50.481476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:50.482380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:50.483133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 34/68] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:50.490516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:50.574979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:50.638439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:50.662471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a325e-36ac-40b1-ae83-78af2cf69998 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:50.699848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:50.700883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.701386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.701830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.702639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:50.703124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:50.704091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c2033-7a03-42af-bab8-5d5bb68eafac None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:50.704933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ad3d-ec1f-4fd4-b588-f0f0f1dcb407 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:50.719117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 35/69] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:12:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:50.720741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa4e6-b3c6-4847-9b24-aa1bc38e71fd None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.721246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa4e6-b3c6-4847-9b24-aa1bc38e71fd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.721663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa4e6-b3c6-4847-9b24-aa1bc38e71fd None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.723061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 36/70] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:50.731266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa4e6-b3c6-4847-9b24-aa1bc38e71fd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:50.744275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc44dff-3db6-43e8-b509-dcdfb6e9baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:50.745590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc44dff-3db6-43e8-b509-dcdfb6e9baea None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.746360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc44dff-3db6-43e8-b509-dcdfb6e9baea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.746790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc44dff-3db6-43e8-b509-dcdfb6e9baea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.760137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc44dff-3db6-43e8-b509-dcdfb6e9baea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2bc44dff-3db6-43e8-b509-dcdfb6e9baea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:50.766967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:50.767982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:50.768798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:50.770020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:12:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:50.773477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.774036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.774508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.785022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:50.797026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:50.798409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:50.853096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa4e6-b3c6-4847-9b24-aa1bc38e71fd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:50.866576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 36/72] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:50.867418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:50.893940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47f91f-f4df-4d4c-92e0-b930aa11beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:50.894508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47f91f-f4df-4d4c-92e0-b930aa11beb0 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.894793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47f91f-f4df-4d4c-92e0-b930aa11beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.895069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47f91f-f4df-4d4c-92e0-b930aa11beb0 None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.910354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47f91f-f4df-4d4c-92e0-b930aa11beb0 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:50.911863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47f91f-f4df-4d4c-92e0-b930aa11beb0 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:50.918422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:50 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:50.918422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf62df-75e9-4327-92c7-ef3c04a2a104 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:50.918422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf62df-75e9-4327-92c7-ef3c04a2a104 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:50.918422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf62df-75e9-4327-92c7-ef3c04a2a104 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:50.918422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 38/74] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:50.918422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf62df-75e9-4327-92c7-ef3c04a2a104 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:50.922972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:50.984260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0601a7-0b9d-43f1-9937-22c9be8d9833 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.025778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.026594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.027034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.027314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.027980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:51.028472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.029999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.032581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.035609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf62df-75e9-4327-92c7-ef3c04a2a104 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.041453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:51.047087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.072031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8448-7c2d-4179-866f-ff8a7bd2a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.072716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8448-7c2d-4179-866f-ff8a7bd2a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.072998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8448-7c2d-4179-866f-ff8a7bd2a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.073275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8448-7c2d-4179-866f-ff8a7bd2a9f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.084160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8448-7c2d-4179-866f-ff8a7bd2a9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-1d5a8448-7c2d-4179-866f-ff8a7bd2a9f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:51.088986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:51.089840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:51.090578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:12:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:51.091824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.092119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.092422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.115597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:51.116888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:51.157606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9f2c-0373-4a9a-b45a-f754ecf2e7eb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.176040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.184089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 40/77] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:51.184933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.191326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.191948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.192233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.192539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.260941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.268362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.269833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.300858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778aac2-ab4f-4547-9190-d9df6a3969f4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.338128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.338825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.339112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.339390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.340546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.342000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.343771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 41/78] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:51.344643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.373890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 38/79] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:12:51.373890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.417484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.466747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.469754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4682d-936b-43f7-a796-6feb8142d549 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.473125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b180e-c828-4e61-93ca-561565197a8c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.503830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.504467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.504748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.505020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.505682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:51.505985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.507135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.507373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.507764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.508047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.508359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.509494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.510908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.512508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 39/80] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:51.513276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.516217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 42/81] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:51.517066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.611889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbc744-4a71-4b9c-81ee-7e105053c54e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.615555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1594524-3efa-4c18-858a-77a63797667d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.638741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.646725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.647369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.647655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.647936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.650419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.651047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.651331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.651602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.652738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.654174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.660709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 43/82] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:51.660709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.682881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.721729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.723213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.761903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f5ec1-6953-4d06-a5f8-9dd1a406cb37 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.794765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.795401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.795684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.795954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.806443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:51.811614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:51.818352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 44/83] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:51.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.829886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 40/84] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:12:51.831359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:51.873144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.895811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:51.922435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e1b77-a7f2-465d-bf01-5744c7a5b1de None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.932967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde788f9-d861-48a7-8b15-bafae2e01c5c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:51.958888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:51.959532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:51.959817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:51.960096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:51.960798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:51.962301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:51.986848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 45/85] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:12:51 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:51.987797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.082061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.083047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.083331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.083613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.084858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.086322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.092916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 41/86] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:52.092916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.123763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139e5c-337c-470e-93a8-f1340c457854 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.135392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:52.170430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.171325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.172457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.173060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.173811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=3e105892d77e451cbb329627efbe0bbb) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:52.174119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.175641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.183454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 46/87] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:12:51 2022] GET /identity/v3/role_assignments?user.id=3e105892d77e451cbb329627efbe0bbb&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:52.184469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.217165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4839214-79af-4cf5-992c-bc2fb4d8a3c2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.268058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:52.284161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.284161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.284161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.284161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.284658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:52.286836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.286836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.298053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 42/88] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:52.298787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.333355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354357b0-3419-47c4-9cb1-c66abbf031cb None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.380029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.381351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.381880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.382214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.383846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.386035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.388314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 47/89] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:52.388952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.440614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:52.446067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259b34-22a7-4c89-9ee5-d364549f04c8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.486130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.487248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.487739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.488502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.528955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc349f-e453-468d-a4b6-1573a63f1327 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.569029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:52.572521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.575194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.598316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.598967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.599248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.599521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.605061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.606516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.608527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 48/90] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:52.609294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.752190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 43/91] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:12:52.757333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.764478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99d8a6-0006-45b0-b506-da49be093373 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.783436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:52.833468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.834578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.835066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.835634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:52.836625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=a53f1ba3fed7453aacc3b6fcf0875642) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:52.837155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:52.838901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:52.850109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 49/92] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/role_assignments?user.id=a53f1ba3fed7453aacc3b6fcf0875642&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:52.851274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:52.882012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:52.888668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2c40-f01e-4483-92f2-3359bf350649 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:52.928207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:52.928207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:52.928207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:52.928207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:53.047889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce27094-33fb-44a0-86d3-fd60e2933dc2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:53.086041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:53.087520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:53.120507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:53.121160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:53.121441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:53.121715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:53.126286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:53.128119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:53.130032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 50/93] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:53.135946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:53.201254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:53.225899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:53.237836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 44/94] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:12:53.243656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:53.287067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf141-3687-4242-9c36-6b92de1eec63 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:53.349846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:53.350472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:53.350753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:53.351025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:53.351757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] RBAC: Adding query filter params (role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=3e105892d77e451cbb329627efbe0bbb) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:53.352062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:53.353546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:53.368491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 51/95] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:12:53 2022] GET /identity/v3/role_assignments?user.id=3e105892d77e451cbb329627efbe0bbb&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=f5ae841af58449728d99fd785708f1ae => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:53.460944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e995a3-94f9-4ba1-8b56-2df8c5b8df52 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:53.516953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918ee67-1976-4863-8893-3094a28337c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:53.518066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ee67-1976-4863-8893-3094a28337c8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:53.518552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ee67-1976-4863-8893-3094a28337c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:53.519052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ee67-1976-4863-8893-3094a28337c8 None admin] PATH_INFO: `/v3/projects/be132513908b41ceabc2f9ceb1322a96` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:53.520565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918ee67-1976-4863-8893-3094a28337c8 None admin] RBAC: Authorizing `identity:get_project(project_id=be132513908b41ceabc2f9ceb1322a96)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:53.522248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918ee67-1976-4863-8893-3094a28337c8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:53.524586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 45/96] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:53 2022] GET /identity/v3/projects/be132513908b41ceabc2f9ceb1322a96 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:53.530212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:53.657188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c005474-0408-49da-9e9d-a3792364eee8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:53.665482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:53.708384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:53.709010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:53.709292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:53.709569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:53.710307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=be132513908b41ceabc2f9ceb1322a96, user.id=3e105892d77e451cbb329627efbe0bbb) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:53.710616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:53.712067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b476a-cd15-45f8-a9f6-68f24a576715 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:53.717876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 52/97] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:12:53 2022] GET /identity/v3/role_assignments?user.id=3e105892d77e451cbb329627efbe0bbb&scope.project.id=be132513908b41ceabc2f9ceb1322a96&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:54.654958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8c407-9f2b-48a3-8b70-b2fe70343d92 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:54.656014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8c407-9f2b-48a3-8b70-b2fe70343d92 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:54.656684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8c407-9f2b-48a3-8b70-b2fe70343d92 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:54.658251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 46/98] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:54.663824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2d36-984f-4c77-9e17-dd94897efa84 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:54.664275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2d36-984f-4c77-9e17-dd94897efa84 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:54.664447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2d36-984f-4c77-9e17-dd94897efa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:54.693255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-215c2d36-984f-4c77-9e17-dd94897efa84 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:54.694467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-215c2d36-984f-4c77-9e17-dd94897efa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:54.778818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 53/99] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:54.935193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd1aa4-5f3d-41f5-91e1-3166e6b04d5a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:54.935496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd1aa4-5f3d-41f5-91e1-3166e6b04d5a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:54.935657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd1aa4-5f3d-41f5-91e1-3166e6b04d5a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:54.937310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 47/100] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:54.942589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1fcbe-870d-4ff0-bc28-0751144eb65e None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:54.942883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1fcbe-870d-4ff0-bc28-0751144eb65e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:54.943160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1fcbe-870d-4ff0-bc28-0751144eb65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:54.965525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4fd1fcbe-870d-4ff0-bc28-0751144eb65e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:54.966955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4fd1fcbe-870d-4ff0-bc28-0751144eb65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:55.042822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 54/101] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:55.133258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd1aa4-5f3d-41f5-91e1-3166e6b04d5a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:55.209672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:55.224388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2bb92-00b1-49e8-a9ed-f1aa11497c76 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.224667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2bb92-00b1-49e8-a9ed-f1aa11497c76 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.224941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2bb92-00b1-49e8-a9ed-f1aa11497c76 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.226657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 55/102] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:55.234428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.234709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.234987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.261662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:55.262969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:55.263731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd1aa4-5f3d-41f5-91e1-3166e6b04d5a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:55.301993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:55.320575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:55.321663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.322145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.322658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.324014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:55.325686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:55.327505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 48/103] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:55.333591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:55.379138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 56/104] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:55.426525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:55.490312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1438-2467-4188-98cb-497a350f27ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:55.536273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f2bda-6d1b-4ead-b767-d3cc6cd2261b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:55.539137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:55.552444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:55.553203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.553606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.553983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.554747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:55.556307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:55.574984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8bb9-fe6d-4031-b86f-6c8bf1156958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:55.575844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8bb9-fe6d-4031-b86f-6c8bf1156958 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.576364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8bb9-fe6d-4031-b86f-6c8bf1156958 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.578417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8bb9-fe6d-4031-b86f-6c8bf1156958 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.598972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8bb9-fe6d-4031-b86f-6c8bf1156958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-a8cb8bb9-fe6d-4031-b86f-6c8bf1156958 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:55.604366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:55.605361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:55.606270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:55.609297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 49/105] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:12:55 2022] POST /identity/v3/projects => generated 302 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:12:55.610575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 57/106] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:55.616552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:55.684717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e7e8-074f-4e91-b8a6-f9f106e58f4d None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.685588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e7e8-074f-4e91-b8a6-f9f106e58f4d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.686002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e7e8-074f-4e91-b8a6-f9f106e58f4d None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.688565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 58/107] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:55.694734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.695190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.695602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.726322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:55.729733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:55.764600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:55.824188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47c7d-06fd-4321-9fdd-beefd3898998 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:55.875477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 59/108] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:12:55.892670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:55.893596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:55.894061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:55.894520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:55.895337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:55.895790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:55.901410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:55.911322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 50/109] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:12:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:55.917198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:55.959401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.038226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:56.078595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b259dfe-9c80-4c71-8705-ba3ec885b6c9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.099709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f25930-052d-4c5e-8c39-5e7e57faf1c6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.118931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.119732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.119838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.120113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.121313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:56.122792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:56.125268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 60/110] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:55 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:56.131349 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.139514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.141053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.141673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.142321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.151272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:56.154828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:56.161717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:56.162547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:12:56.163308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:56.165773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 51/111] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:56.171870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.272957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c673-6a6d-4429-8987-aeec7836ea6f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.339660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.340468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.340756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.341031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.344463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:56.346773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:56.349581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 61/112] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:56 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:56.356129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.362386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5b5cf-63ba-4c29-bca5-1fe7af6c6ea7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.366287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:56.434156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.434829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.435160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.435442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.436116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:56.436446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:56.439452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:56.454754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 52/113] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:12:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:56.455593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.540620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:56.582715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4566e1-63d5-4158-8e6c-10d4647ac90a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.586311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef689f-527c-441d-9c52-5082ce71992b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.637802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.638779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.639227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.639692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/3e105892d77e451cbb329627efbe0bbb/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.642382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] RBAC: Authorizing `identity:create_grant(project_id=6a35b03e050843e983b8cf7876ee349d, user_id=3e105892d77e451cbb329627efbe0bbb, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:56.642880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ca543-2c39-49bd-8529-7018cb0466b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.643579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ca543-2c39-49bd-8529-7018cb0466b3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.643858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ca543-2c39-49bd-8529-7018cb0466b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.643984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:56.644169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ca543-2c39-49bd-8529-7018cb0466b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.654878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ca543-2c39-49bd-8529-7018cb0466b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:56.659899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 53/114] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:12:56 2022] PUT /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/3e105892d77e451cbb329627efbe0bbb/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:12:56.660761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-a89ca543-2c39-49bd-8529-7018cb0466b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:56.661176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:56.662025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:56.662835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 62/115] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:56.663483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3fd9f-0b4c-4b33-9b68-152710390a4d None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.668558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3fd9f-0b4c-4b33-9b68-152710390a4d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.668928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3fd9f-0b4c-4b33-9b68-152710390a4d None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.670575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 63/116] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:56.674109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80318ff-f0c7-4e4d-944f-22c55fbb3197 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.674402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80318ff-f0c7-4e4d-944f-22c55fbb3197 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.674679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80318ff-f0c7-4e4d-944f-22c55fbb3197 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.680167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 64/117] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:56.680524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80318ff-f0c7-4e4d-944f-22c55fbb3197 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:56.703973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:56.797159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322d360-f99e-4067-925e-97bc00cdb59b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.828678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80318ff-f0c7-4e4d-944f-22c55fbb3197 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:56.844322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55494-3f59-4b30-8243-8915c858dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.844984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55494-3f59-4b30-8243-8915c858dea2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.845270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55494-3f59-4b30-8243-8915c858dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.845554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55494-3f59-4b30-8243-8915c858dea2 None admin] PATH_INFO: `/v3/users/3cf7980944e24a4ba4e74a527fefc3bf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.862711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55494-3f59-4b30-8243-8915c858dea2 None admin] RBAC: Authorizing `identity:get_user(user_id=3cf7980944e24a4ba4e74a527fefc3bf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:56.864266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55494-3f59-4b30-8243-8915c858dea2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:56.866219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 54/118] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:56 2022] GET /identity/v3/users/3cf7980944e24a4ba4e74a527fefc3bf => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:56.867431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.867816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.868099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.873247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:56.873884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.874167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.874538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.875352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:56.875658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:56.877065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f972d-8ee2-43f1-8ac0-f805dc0c7b73 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:56.891586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 65/119] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:56.894275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:56.894816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:56.895318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:56.904070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:56.904691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:56.911511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:56.919212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:56.920952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:56.989789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 55/120] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:56.997307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.011713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 66/121] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:57.012788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.043837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:57.223805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3810a2-4ce0-4648-a8e3-3bd73aad0df8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.256799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab605cb-28d2-4206-9b73-cc16009f4596 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.291911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.292616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.292900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.293174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.294418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:57.295921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:57.298238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 67/122] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:57.305409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.312667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:57.324547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.325175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.325454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.325731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.434139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091391e9-f24b-485a-b496-08d12c0dd58a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.445014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:57.447377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:57.466923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:57.480866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.481719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.482012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.482294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.483690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:57.486049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:57.488378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 68/123] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:12:57.489433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.575239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:57.588276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 56/124] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:12:57.588276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.621716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5f16b-3d59-46e1-aa21-b7916770a8ae None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.666928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.667609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.667895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.668173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.683392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:57.691399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:57.692234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:12:57.693026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 69/125] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:57.693638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.704393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6d5a7-babf-42a1-9dfe-f3383728b2ad None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.720227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:57.743758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.744773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.745300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.745765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.760141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:57.771220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:57.772144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:12:57.772935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:57.775227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 57/126] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:12:57.776217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.833410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb938-a7c9-445e-bc95-4fa427bddd7b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.878881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:57.886889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.887809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.888094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.888405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/a53f1ba3fed7453aacc3b6fcf0875642/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.891057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a35b03e050843e983b8cf7876ee349d, user_id=a53f1ba3fed7453aacc3b6fcf0875642, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:57.892497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632966f-79eb-4f9e-92ae-ec496a3c03cb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:57.892947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:57.915754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 70/127] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:12:57 2022] PUT /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/a53f1ba3fed7453aacc3b6fcf0875642/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:12:57.916673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:57.941020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:57.942370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:57.942902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:57.943513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:57.945462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:57.947336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:57.949632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 58/128] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:57.956314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.027795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:58.055541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524a58d-089c-4a46-8e1b-52cb8e2f3916 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.107754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.110009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.110518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.110808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.111519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:58.114320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.115790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.141137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec951c7-6050-408c-9816-9ec223d5ecc6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.147492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 71/129] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.148445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.215824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.216525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.217943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.217943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.218861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:58.219271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.220735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.235102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 59/130] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:12:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.235102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.246362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:58.302036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83835d0-c43d-4a38-aab7-f3d9e6f66b8d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.340681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.341706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.342439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.343407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.344701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] RBAC: Adding query filter params (role.id=011ebccde97b4885abd94a1a99e6923c, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=3cf7980944e24a4ba4e74a527fefc3bf) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:12:58.345264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.347149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.353576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 72/131] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:12:58 2022] GET /identity/v3/role_assignments?user.id=3cf7980944e24a4ba4e74a527fefc3bf&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=011ebccde97b4885abd94a1a99e6923c => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.354781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.377909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb0f6-da46-43bd-bea2-d1c4a7431276 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.381508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:58.459744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddea7a7-4abc-4506-b909-08eb7a15725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.460901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea7a7-4abc-4506-b909-08eb7a15725d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.461385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea7a7-4abc-4506-b909-08eb7a15725d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.461873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddea7a7-4abc-4506-b909-08eb7a15725d None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.463557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea7a7-4abc-4506-b909-08eb7a15725d None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.466764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddea7a7-4abc-4506-b909-08eb7a15725d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.474098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 60/132] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:58 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.475746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2be93-1155-4928-9c1c-1050604bc0f5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.477834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2be93-1155-4928-9c1c-1050604bc0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.480690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2be93-1155-4928-9c1c-1050604bc0f5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.482426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 61/133] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:58.483395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2be93-1155-4928-9c1c-1050604bc0f5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.533704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d4e7-4b0f-4438-a89d-468c15b79ca8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.554959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:58.579841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1e251-c790-4b7e-bf9c-2a1effe4cbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.580627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e251-c790-4b7e-bf9c-2a1effe4cbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.580913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e251-c790-4b7e-bf9c-2a1effe4cbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.588307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e251-c790-4b7e-bf9c-2a1effe4cbe2 None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.589221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1e251-c790-4b7e-bf9c-2a1effe4cbe2 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.590760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1e251-c790-4b7e-bf9c-2a1effe4cbe2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.592883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 73/134] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:12:58 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.599531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.599837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.600118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.636951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:58.638183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:58.716429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 74/135] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:12:58.717219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.752947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2be93-1155-4928-9c1c-1050604bc0f5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.823551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ccf6b-e3e1-404d-a552-fc5424b89a93 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:58.844394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:58.863360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.863962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.864276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.864615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.866363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.868078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.869913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 75/136] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:58 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.876231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.885493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:58.886161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:58.886477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:58.886761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] PATH_INFO: `/v3/projects/be132513908b41ceabc2f9ceb1322a96` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:58.893026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] RBAC: Authorizing `identity:get_project(project_id=be132513908b41ceabc2f9ceb1322a96)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:58.894485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:58.896545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 62/137] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:12:58 2022] GET /identity/v3/projects/be132513908b41ceabc2f9ceb1322a96 => generated 312 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:58.902344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:58.952109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:59.003236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4506360-127f-4515-aa3c-b1fa7fda8f0c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:59.021351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8729e36-7663-4bf1-a208-d5ce9833c015 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:59.042782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a949c-b7a6-4edb-bad6-3885c277bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:59.043782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a949c-b7a6-4edb-bad6-3885c277bc40 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.044286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a949c-b7a6-4edb-bad6-3885c277bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.044757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a949c-b7a6-4edb-bad6-3885c277bc40 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/3e105892d77e451cbb329627efbe0bbb/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.047918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a949c-b7a6-4edb-bad6-3885c277bc40 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a35b03e050843e983b8cf7876ee349d, user_id=3e105892d77e451cbb329627efbe0bbb, role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:59.049625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a949c-b7a6-4edb-bad6-3885c277bc40 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:59.064720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 76/138] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:12:58 2022] PUT /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/3e105892d77e451cbb329627efbe0bbb/roles/f5ae841af58449728d99fd785708f1ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:12:59.067029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ebd85-f306-440c-b69e-4145575183c1 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.067677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ebd85-f306-440c-b69e-4145575183c1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.068390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ebd85-f306-440c-b69e-4145575183c1 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.070210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 77/139] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:12:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:12:59.076103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.076844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.077365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.085343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:59.086055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.086344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.086626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] PATH_INFO: `/v3/projects/be132513908b41ceabc2f9ceb1322a96/users/3e105892d77e451cbb329627efbe0bbb/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.092990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] RBAC: Authorizing `identity:create_grant(project_id=be132513908b41ceabc2f9ceb1322a96, user_id=3e105892d77e451cbb329627efbe0bbb, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:59.094779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:59.100533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:12:59.102790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:12:59.122745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 63/140] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:12:58 2022] PUT /identity/v3/projects/be132513908b41ceabc2f9ceb1322a96/users/3e105892d77e451cbb329627efbe0bbb/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:12:59.155474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:59.190162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 78/141] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:12:59.263577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:59.401023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:59.406207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5274a3-5e99-42fb-8867-5f7fda8b5fff None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:59.447958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:59.448647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.448932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.449211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.450994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:59.452549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:59.454887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 64/142] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:12:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:12:59.465337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:59.587621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58cc90-a4e4-4278-a0b4-f4ffffc538ef None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:59.589751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:59.629827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:59.630368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.630650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.630972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.631629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:12:59.633225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:12:59.661480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 79/143] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:12:59 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:12:59.768027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a56fc-25f7-4111-aa31-e4e6e35993bb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:12:59.816508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:12:59.817182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:12:59.817468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:12:59.817813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:12:59.837311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:12:59.842897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:12:59.844436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:12:59.845209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:12:59.848306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 65/144] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:12:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:12:59.850006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:12:59.898048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:12:59.989236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46bd40-af54-40ef-a0e5-248df54edc99 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:00.028527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:00.029153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.029426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.029759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:00.030379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:00.030782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:00.032554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:00.041549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 80/145] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:00.047560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:00.083115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:00.174649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd6fd6-7068-478c-9915-fc0ed97244c0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:00.217832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:00.219572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.220091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.220608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:00.223619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:00.228753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:00.228753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 66/146] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:00 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:00.235113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:00.360081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:00.368967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a9b3-21d4-46a0-8e60-6ca2ebb331e7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:00.404894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:00.406031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.406323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.406818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:00.479403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:00.481004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:00.574935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:00.587932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 81/147] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:00.596638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:00.715385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:00.726655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae85414-3eb6-42ee-abdb-9538e10bb513 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:00.764723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea33185-7f39-4bd2-93ea-b6e82e91d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:00.765928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea33185-7f39-4bd2-93ea-b6e82e91d7ea None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.766209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea33185-7f39-4bd2-93ea-b6e82e91d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.766525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea33185-7f39-4bd2-93ea-b6e82e91d7ea None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:00.773004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea33185-7f39-4bd2-93ea-b6e82e91d7ea None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:00.774481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea33185-7f39-4bd2-93ea-b6e82e91d7ea None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:00.776366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 67/148] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:00 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:00.783432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:00.922914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d39f-be2d-4c8e-bfb0-426aec3c8468 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:00.966050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:00.966595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.966880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.967156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:00.967901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=3e105892d77e451cbb329627efbe0bbb) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:00.968432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:00.969999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cebfe1-dc09-409a-b13f-c8f50dd966b9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:00.976723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 82/149] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:00 2022] GET /identity/v3/role_assignments?user.id=3e105892d77e451cbb329627efbe0bbb&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:00.977781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec857-2a76-48a6-ba3d-2306aef05f8c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.978074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec857-2a76-48a6-ba3d-2306aef05f8c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.978356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec857-2a76-48a6-ba3d-2306aef05f8c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:00.979811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 68/150] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:00.985799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:00.986146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:00.986362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:01.013429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:01.014667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:01.088347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d415d-1f8a-4dc2-a58d-90cd31a63df2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:01.088840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d415d-1f8a-4dc2-a58d-90cd31a63df2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:01.088911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d415d-1f8a-4dc2-a58d-90cd31a63df2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:01.090268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 69/151] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:01.097024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:01.097330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:01.097639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:01.101574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:01.133890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:01.135497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:01.157432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 83/152] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:01.248790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 70/153] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:01.611471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:01.740542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e198716-9aea-4412-b717-afebbb7369ac None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:01.750334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:01.789580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971a5a2-6337-4944-be35-c5abd80f22bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:01.790489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a5a2-6337-4944-be35-c5abd80f22bb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:01.790774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a5a2-6337-4944-be35-c5abd80f22bb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:01.791048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971a5a2-6337-4944-be35-c5abd80f22bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:01.810635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971a5a2-6337-4944-be35-c5abd80f22bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-5971a5a2-6337-4944-be35-c5abd80f22bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:01.817412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:01.818258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:01.818997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 84/154] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:01.822710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2f5c-b4f8-475a-a0b8-37214b9c6d6c None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:01.823002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2f5c-b4f8-475a-a0b8-37214b9c6d6c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:01.823278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2f5c-b4f8-475a-a0b8-37214b9c6d6c None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:01.824740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 85/155] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:13:01.826354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2f5c-b4f8-475a-a0b8-37214b9c6d6c None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:01.905673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:01.944605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:01.956892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2d9a4-4edd-4698-8e33-4802536a370a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:01.963600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2f5c-b4f8-475a-a0b8-37214b9c6d6c None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.003394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.004016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.004310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.004585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.005252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:02.005553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:02.012292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52759aaa-14f2-41b8-ad36-5ee5bca61699 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:02.021076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 86/156] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:02.023050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.023334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.023790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.048613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:02.049922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:02.057578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.058217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.058505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.058786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.087474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:02.092273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:02.093924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:02.094780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:02.105582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 71/157] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:02.109276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.165446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 87/158] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:02.166007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.258540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:02.316437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7efcb-a439-432d-a454-bf52dd0b918b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.363198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd58b0-c539-49e7-9473-1efba2a4db09 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.387617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.388774 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.389326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.390395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] PATH_INFO: `/v3/users/3cf7980944e24a4ba4e74a527fefc3bf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.394296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] RBAC: Authorizing `identity:get_user(user_id=3cf7980944e24a4ba4e74a527fefc3bf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:02.396143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:02.399737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 72/159] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:02 2022] GET /identity/v3/users/3cf7980944e24a4ba4e74a527fefc3bf => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:02.408304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.408787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.409505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.409785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.410125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.410821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:02.411267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:02.413030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:02.425120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 88/160] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:02.431841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.459978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:02.561009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ea757-70f9-4dfa-8278-465ade8097ff None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.620639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07defa-a93c-4fb3-82c9-be37f0c5c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.621466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07defa-a93c-4fb3-82c9-be37f0c5c94a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.621746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07defa-a93c-4fb3-82c9-be37f0c5c94a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.622069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07defa-a93c-4fb3-82c9-be37f0c5c94a None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.623118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:02.623229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07defa-a93c-4fb3-82c9-be37f0c5c94a None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:02.626236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07defa-a93c-4fb3-82c9-be37f0c5c94a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:02.628039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 73/161] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:02 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:02.629307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0d052-e7c1-453e-a6d4-f2778e088149 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.629434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abceeb3-e93e-4a23-9e53-b3fd96e16dbc None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.629597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0d052-e7c1-453e-a6d4-f2778e088149 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.629842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0d052-e7c1-453e-a6d4-f2778e088149 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.631444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 74/162] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:02.631971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0d052-e7c1-453e-a6d4-f2778e088149 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.672872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52d99-eb74-455c-8d56-ca6eb9d24588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.673924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d99-eb74-455c-8d56-ca6eb9d24588 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.674528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d99-eb74-455c-8d56-ca6eb9d24588 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.675087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d99-eb74-455c-8d56-ca6eb9d24588 None admin] PATH_INFO: `/v3/users/a53f1ba3fed7453aacc3b6fcf0875642` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.676545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52d99-eb74-455c-8d56-ca6eb9d24588 None admin] RBAC: Authorizing `identity:get_user(user_id=a53f1ba3fed7453aacc3b6fcf0875642)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:02.678197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52d99-eb74-455c-8d56-ca6eb9d24588 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:02.680558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 89/163] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:02 2022] GET /identity/v3/users/a53f1ba3fed7453aacc3b6fcf0875642 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:02.681998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.682498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.683005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.704465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:02.706096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:02.750513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:02.763577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0d052-e7c1-453e-a6d4-f2778e088149 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.783490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 90/164] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:02.784858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.804758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157729-7826-4cac-905a-e201400f2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.805393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157729-7826-4cac-905a-e201400f2159 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.805673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157729-7826-4cac-905a-e201400f2159 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.805943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af157729-7826-4cac-905a-e201400f2159 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.821028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af157729-7826-4cac-905a-e201400f2159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-af157729-7826-4cac-905a-e201400f2159 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:02.826839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:02.827918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:02.829134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:02.833723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 75/165] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:02.834699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157729-7826-4cac-905a-e201400f2159 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:02.906102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:02.911295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b2a3-cdd7-45ec-9472-4c47d72a2d9d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.978715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af157729-7826-4cac-905a-e201400f2159 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:02.982334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:02.983005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:02.983278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:02.984062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/3cf7980944e24a4ba4e74a527fefc3bf/roles/011ebccde97b4885abd94a1a99e6923c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:02.990837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a35b03e050843e983b8cf7876ee349d, user_id=3cf7980944e24a4ba4e74a527fefc3bf, role_id=011ebccde97b4885abd94a1a99e6923c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:02.992321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:03.014406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 91/166] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:02 2022] PUT /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d/users/3cf7980944e24a4ba4e74a527fefc3bf/roles/011ebccde97b4885abd94a1a99e6923c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:03.016004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:03.055141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:03.056231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:03.057581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:03.058488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:03.102303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:03.196641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:03.200143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:03.255743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c52a2-5a48-4a53-8243-87c50a24c2b6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:03.330639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:03.331266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:03.331549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:03.331823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:03.336658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:03.336981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:03.338419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:03.357185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 92/167] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:03.358058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:03.435792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:03.457230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 76/168] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:03.458364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:03.564550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:03.601037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401961e7-7c48-4b04-920a-f019f0cca244 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:03.648985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:03.649648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:03.649938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:03.650211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:03.664091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de9834-28a8-4322-8887-490b19c17ddc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:03.665367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:03.670657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:03.672453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:03.673235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:03.680430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 93/169] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:03.681284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:03.756975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:03.757625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:03.757901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:03.758165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:03.759369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:03.760840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:03.762637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 77/170] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:03.763171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:03.810406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:03.866479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d1752-c149-44b4-a4a1-a8982490a9e4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:03.892837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab80c9-a3ee-4d4d-85ed-c8d5e4aa825d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:03.912595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:03.930547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:03.931246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:03.931609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:03.932096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:03.932986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:03.933348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:03.935016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:03.944973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 78/171] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:03.945927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:03.960977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:03.961639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:03.961921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:03.962195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:03.963366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:03.964869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:03.966678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 94/172] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:03.967281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:04.084479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0290e-f601-470b-81c9-f4c0d8f15681 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.095299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b43ca-a217-4179-912a-e3f5ba5b08e5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.139791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.140846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.141135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.141420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] PATH_INFO: `/v3/users/3e105892d77e451cbb329627efbe0bbb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.142700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] RBAC: Authorizing `identity:get_user(user_id=3e105892d77e451cbb329627efbe0bbb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.144328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.145921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 95/173] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/users/3e105892d77e451cbb329627efbe0bbb => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:04.146750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:04.149811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a965-e81d-4759-a1d9-c6a7d3868b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.150926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a965-e81d-4759-a1d9-c6a7d3868b81 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.151394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a965-e81d-4759-a1d9-c6a7d3868b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.151842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a965-e81d-4759-a1d9-c6a7d3868b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.168600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.250056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.266436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f05bc6-cfd9-443b-b0c1-9586532b5def None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.299033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a965-e81d-4759-a1d9-c6a7d3868b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.300520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a965-e81d-4759-a1d9-c6a7d3868b81 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.305771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.306568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.306985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.307411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.308295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=a53f1ba3fed7453aacc3b6fcf0875642) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:04.308737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.311176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.318482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 96/174] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:04 2022] GET /identity/v3/role_assignments?user.id=a53f1ba3fed7453aacc3b6fcf0875642&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:04.319639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:04.426194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.445456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 79/175] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:04.446685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a40e-01e0-4d55-a54a-a7d0e1919be3 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.447031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a40e-01e0-4d55-a54a-a7d0e1919be3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.447364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003a40e-01e0-4d55-a54a-a7d0e1919be3 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.448912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 80/176] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:04.450046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713847-3ec1-4942-ba59-fc71b97736b1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.450382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713847-3ec1-4942-ba59-fc71b97736b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.450658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713847-3ec1-4942-ba59-fc71b97736b1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.452013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 81/177] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:04.453147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ada5-90a5-49d8-912c-9065d9c78d0d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.454032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713847-3ec1-4942-ba59-fc71b97736b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:04.498099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84228cfe-7291-4dc1-a195-222a6740ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.499458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84228cfe-7291-4dc1-a195-222a6740ddae None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.499881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84228cfe-7291-4dc1-a195-222a6740ddae None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.500357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84228cfe-7291-4dc1-a195-222a6740ddae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.544526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.569115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713847-3ec1-4942-ba59-fc71b97736b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.596999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84228cfe-7291-4dc1-a195-222a6740ddae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.598742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84228cfe-7291-4dc1-a195-222a6740ddae None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.616231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455bb30-7a95-4a5a-897e-d1132b62e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.617726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455bb30-7a95-4a5a-897e-d1132b62e3ce None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.618263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455bb30-7a95-4a5a-897e-d1132b62e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.618675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455bb30-7a95-4a5a-897e-d1132b62e3ce None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.620666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455bb30-7a95-4a5a-897e-d1132b62e3ce None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.622434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455bb30-7a95-4a5a-897e-d1132b62e3ce None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.624962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 82/178] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:04 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:04.626756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.627457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.627880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.653137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:04.654064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:04.695624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.718715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 97/179] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:04.720180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.720622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.721065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.733642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 83/180] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:04.735129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:04.741418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:04.742960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:04.817422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 98/181] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:04.818629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:04.826697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.852611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec44d97-787f-4d9b-a5cf-8876833215e0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.894295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.894980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.895336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.895535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.896308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] RBAC: Adding query filter params (role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=3e105892d77e451cbb329627efbe0bbb) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:04.896622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.898850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81a45-23da-43f5-9cc2-44c46515c4cc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.908389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 84/182] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:04 2022] GET /identity/v3/role_assignments?user.id=3e105892d77e451cbb329627efbe0bbb&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=f5ae841af58449728d99fd785708f1ae => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:04.909704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225f451-cf3a-41d4-aef4-067de0123eee None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.909996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225f451-cf3a-41d4-aef4-067de0123eee None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.910271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225f451-cf3a-41d4-aef4-067de0123eee None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.911934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 85/183] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:04.917380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.917844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.918228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.933829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535626-6af7-4833-9617-131e0c0f4de8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:04.945812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:04.946825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:04.947653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:04.975938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:04.977108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:04.977108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:04.977315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] PATH_INFO: `/v3/projects/be132513908b41ceabc2f9ceb1322a96` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:04.978479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] RBAC: Authorizing `identity:get_project(project_id=be132513908b41ceabc2f9ceb1322a96)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:04.979934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:04.982104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 99/184] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:04 2022] GET /identity/v3/projects/be132513908b41ceabc2f9ceb1322a96 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:04.989633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.086179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 86/185] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:05.106579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.201382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cccb82-63f0-4a19-9106-418b27ac880c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.219158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:05.257206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b09475-77f3-43ed-a5f6-ba75c5a7f02f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.269303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.270009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.270392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.270761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.271592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=be132513908b41ceabc2f9ceb1322a96, user.id=3e105892d77e451cbb329627efbe0bbb) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:05.272002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:05.273636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:05.285059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 100/186] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:04 2022] GET /identity/v3/role_assignments?user.id=3e105892d77e451cbb329627efbe0bbb&scope.project.id=be132513908b41ceabc2f9ceb1322a96&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:05.309314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.310155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.310532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.310900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.323384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:05.329478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:05.330507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:05.331426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:05.333414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 87/187] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:05.339491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.391042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:05.421871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.463003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab853f4-f3ca-4ff4-ba99-4b7a299989c5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.522069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.522770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.523567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.523567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.524087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:05.524473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:05.525910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:05.537108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 101/188] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:05.537677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.575385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7df5-23e4-4991-b9b3-bb9dbf6f0fdd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.622569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:05.629159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.630256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.630595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.630964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.632177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:05.633715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:05.635415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 88/189] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:05.636325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.659347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a304c3f-a46c-4f49-b1c8-9fe82f4b9576 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.661913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:05.709145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.709884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.710171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.710448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.721838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:05.726618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:05.727478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:05.728267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 102/190] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:05.729297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.758526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ddcb0-c6f2-446b-a78c-c0a7c902015e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.797921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.798563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.799150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.799150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] PATH_INFO: `/v3/users/0be00de6cae1465ab2810240fb5e697d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.813128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] RBAC: Authorizing `identity:get_user(user_id=0be00de6cae1465ab2810240fb5e697d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:05.814588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:05.816293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 89/191] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/users/0be00de6cae1465ab2810240fb5e697d => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:05.817085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.836924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ff9ac-d0fa-4337-bdb7-c68b0e27be11 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.871946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361abb9-f17d-40a2-873a-2b70fb9ad363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.872590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361abb9-f17d-40a2-873a-2b70fb9ad363 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.872869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361abb9-f17d-40a2-873a-2b70fb9ad363 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.873143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361abb9-f17d-40a2-873a-2b70fb9ad363 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.873787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361abb9-f17d-40a2-873a-2b70fb9ad363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:05.876033 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361abb9-f17d-40a2-873a-2b70fb9ad363 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:05.883048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:05.896065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 103/192] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:05 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:05.897681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8cf95-db10-4561-8e69-29071585e948 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.898221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8cf95-db10-4561-8e69-29071585e948 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.898347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8cf95-db10-4561-8e69-29071585e948 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.899689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 104/193] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:05.904300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8cf95-db10-4561-8e69-29071585e948 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:05.930294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:05.936156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08398b9-b0b5-48bf-9c0a-caa9192f7c4f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:05.974686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:05.975434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.975542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.975792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:05.976516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:05.976819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:05.979830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da7a55-4592-4a31-9ba3-1b7eb7fe8ba7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:05.987794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 90/194] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:05.993640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:05.994022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:05.994200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.016930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:06.018157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:06.036909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8cf95-db10-4561-8e69-29071585e948 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.087434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.088068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.088383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.088665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.101072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 91/195] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:06.102663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.170573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:06.185638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:06.189258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:06.221895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:06.230452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263ca54-9d35-4003-828e-fb149cda5774 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.276963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.277610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.277891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.278165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] PATH_INFO: `/v3/users/0be00de6cae1465ab2810240fb5e697d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.280116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] RBAC: Authorizing `identity:get_user(user_id=0be00de6cae1465ab2810240fb5e697d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:06.282461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:06.284992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 92/196] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/users/0be00de6cae1465ab2810240fb5e697d => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:06.290716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.325106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 105/197] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:06.331742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.422013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d3da6-d361-4306-9afa-8b6f7ff6fc99 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.438508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205698a-60dd-485c-8a0d-bde0703a07e1 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.441529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:06.461537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:06.467804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.468459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.468816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.469098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.483007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.483667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.483965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.484386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.485638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:06.487082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:06.493573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 106/198] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:06.494405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.564268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:06.566069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:06.617770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcf714-a1b3-4890-a7c7-b94d68a16fa0 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.655134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.656080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.656519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.656902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.667894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:06.674096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:06.674970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:06.675726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:06.680192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 107/199] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:06.681070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.689260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 93/200] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:06.690189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.713606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:06.737637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:06.797948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d450-a50b-4aac-bbf7-ccb93bef11a7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.813924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ed6b-6fc9-4714-b183-52e59ad4b6cc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:06.839290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.839910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.840195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.840495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.841340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=0be00de6cae1465ab2810240fb5e697d) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:06.841749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:06.844321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:06.850853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 108/201] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/role_assignments?user.id=0be00de6cae1465ab2810240fb5e697d&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:06.851666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:06.861033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:06.861673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:06.864273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:06.864273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:06.864273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:06.864273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:06.870482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:06.891216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 94/202] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:06.897427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:07.037462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22bdd9-8efa-4a4d-932a-e415e7a8a1b5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:07.047098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:07.054455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:07.070216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9de4b9-65aa-4e6d-8f05-ec336b45f8d9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:07.081481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:07.082448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:07.082940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:07.083407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:07.085613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:07.087343 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:07.089364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 109/203] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:07.095255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:07.108195 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:07.109316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:07.109316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:07.109528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] PATH_INFO: `/v3/users/3cf7980944e24a4ba4e74a527fefc3bf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:07.110650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] RBAC: Authorizing `identity:get_user(user_id=3cf7980944e24a4ba4e74a527fefc3bf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:07.112192 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:07.116367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 95/204] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:06 2022] GET /identity/v3/users/3cf7980944e24a4ba4e74a527fefc3bf => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:07.120031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:07.226004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28b49-eb91-4349-a343-6e6b4ef95c5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:07.261376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c4b3-5465-4f95-b2c1-cda2af267726 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:07.299272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:07.299790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:07.299907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:07.300154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:07.300449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:07.301317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:07.301801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:07.302279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:07.303204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] RBAC: Adding query filter params (role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=0be00de6cae1465ab2810240fb5e697d) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:07.303747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:07.305505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:07.313056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 110/205] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:07 2022] GET /identity/v3/role_assignments?user.id=0be00de6cae1465ab2810240fb5e697d&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=f5ae841af58449728d99fd785708f1ae => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:07.345477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:07.416444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:07.417928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:07.527711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 96/206] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:07.533392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:07.599433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:07.672949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dddfb-7e4e-46dd-98f1-aba157114e64 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:07.723691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786eb460-5e20-4f36-b035-1e0f1883a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:07.724369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb460-5e20-4f36-b035-1e0f1883a44f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:07.724655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb460-5e20-4f36-b035-1e0f1883a44f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:07.724932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb460-5e20-4f36-b035-1e0f1883a44f None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:07.726066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786eb460-5e20-4f36-b035-1e0f1883a44f None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:07.727527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786eb460-5e20-4f36-b035-1e0f1883a44f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:07.729503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 111/207] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:07 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:07.735410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:07.824143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:07.907629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa58f20-ea70-4a98-b371-b3ad7df9729f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:07.947717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:07.948356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:07.948638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:07.948913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:07.949650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] RBAC: Adding query filter params (role.id=011ebccde97b4885abd94a1a99e6923c, scope.project.id=6a35b03e050843e983b8cf7876ee349d, user.id=3cf7980944e24a4ba4e74a527fefc3bf) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:07.949965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:07.951390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bae55-e4c6-4e58-af8a-026e0b56a59f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:07.958692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 97/208] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:07 2022] GET /identity/v3/role_assignments?user.id=3cf7980944e24a4ba4e74a527fefc3bf&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=011ebccde97b4885abd94a1a99e6923c => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:08.267218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3d00-0f76-4ec7-b37a-776d7478b0f6 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:08.267694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3d00-0f76-4ec7-b37a-776d7478b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:08.267694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3d00-0f76-4ec7-b37a-776d7478b0f6 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:08.269294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 112/209] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:08.275745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da744004-fb29-4797-bf6e-d9905deb0b51 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:08.276033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da744004-fb29-4797-bf6e-d9905deb0b51 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:08.276335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da744004-fb29-4797-bf6e-d9905deb0b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:08.296941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-da744004-fb29-4797-bf6e-d9905deb0b51 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:08.298126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da744004-fb29-4797-bf6e-d9905deb0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:08.373870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 98/210] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:08.615162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067600e-fdc4-46b2-924b-e950ec8cb9c3 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:08.615714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067600e-fdc4-46b2-924b-e950ec8cb9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:08.616132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067600e-fdc4-46b2-924b-e950ec8cb9c3 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:08.618024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 113/211] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:08.623465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:08.623752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:08.624633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:08.644713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:08.646208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:08.679687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067600e-fdc4-46b2-924b-e950ec8cb9c3 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:08.684295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:08.723355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 99/212] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:08.802897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067600e-fdc4-46b2-924b-e950ec8cb9c3 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:08.828915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:08.839360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:08.840286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:08.841060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:08.841547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:08.853298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:08.858990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:08.859871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:08.860697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:08.864171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 114/213] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:08.869818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:08.974566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53dd13-59f1-4e6a-815f-09c00d0acb4d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.018918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.019871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.020407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.020879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.021744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:09.022248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:09.023824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:09.026833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.033571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 100/214] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:09.041355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.089352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:09.144518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7503ef-8baf-46b8-8ae2-3aa78c707005 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.169439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd075-5e93-432a-8213-741e25321d3d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.182431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee780c-6673-41e2-ba31-635d6e0e354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.183322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee780c-6673-41e2-ba31-635d6e0e354b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.183794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee780c-6673-41e2-ba31-635d6e0e354b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.184172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee780c-6673-41e2-ba31-635d6e0e354b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.185322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee780c-6673-41e2-ba31-635d6e0e354b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:09.187874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee780c-6673-41e2-ba31-635d6e0e354b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:09.193918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 115/215] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:09.193918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f50ef-9fdd-4a34-9b16-d700cdea5bec None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.193918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f50ef-9fdd-4a34-9b16-d700cdea5bec None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.193918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f50ef-9fdd-4a34-9b16-d700cdea5bec None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.193918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 116/216] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:09.197123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f50ef-9fdd-4a34-9b16-d700cdea5bec None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.212085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff528f9-a506-4bb0-b58b-a62ba53b8709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.212773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff528f9-a506-4bb0-b58b-a62ba53b8709 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.213090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff528f9-a506-4bb0-b58b-a62ba53b8709 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.213365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff528f9-a506-4bb0-b58b-a62ba53b8709 None admin] PATH_INFO: `/v3/users/c169c40f2ced468893969de8c95a3cea` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.226958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff528f9-a506-4bb0-b58b-a62ba53b8709 None admin] RBAC: Authorizing `identity:get_user(user_id=c169c40f2ced468893969de8c95a3cea)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:09.228425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff528f9-a506-4bb0-b58b-a62ba53b8709 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:09.230047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 101/217] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/users/c169c40f2ced468893969de8c95a3cea => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:09.231179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.231457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.231725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.249648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:09.249826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:09.250998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:09.315962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f50ef-9fdd-4a34-9b16-d700cdea5bec None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.322517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 102/218] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:09.323275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.360261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.360461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:09.361307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.361861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.362229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.363051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:09.364652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:09.395550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 117/219] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:09 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:09.452063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbdaae-2bbc-4efb-8e17-7a18b4d9dcd1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.493521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65f8d4-5b4b-4b43-b38b-b2ab36f83cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.494505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65f8d4-5b4b-4b43-b38b-b2ab36f83cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.494956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65f8d4-5b4b-4b43-b38b-b2ab36f83cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.495424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65f8d4-5b4b-4b43-b38b-b2ab36f83cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.568749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65f8d4-5b4b-4b43-b38b-b2ab36f83cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:09.570639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65f8d4-5b4b-4b43-b38b-b2ab36f83cc0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:09.597101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:09.618740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.678291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 103/220] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:09.679493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d543b-5fed-4b8d-870c-27343a9c3f65 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.679779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d543b-5fed-4b8d-870c-27343a9c3f65 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.680047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d543b-5fed-4b8d-870c-27343a9c3f65 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.681332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 104/221] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:09.685083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d543b-5fed-4b8d-870c-27343a9c3f65 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.751198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:09.760591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f0fa5-4169-482f-b7aa-fbf37e43e915 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.800069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e910-8aab-49c3-84c6-bef8245efdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.801149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e910-8aab-49c3-84c6-bef8245efdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.801480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e910-8aab-49c3-84c6-bef8245efdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.801755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e910-8aab-49c3-84c6-bef8245efdf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.814807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e910-8aab-49c3-84c6-bef8245efdf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7c92e910-8aab-49c3-84c6-bef8245efdf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:09.822160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:09.823056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:09.823836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 118/222] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:09.825617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.825879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.826149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.835632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d543b-5fed-4b8d-870c-27343a9c3f65 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:09.851060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:09.852960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:09.860940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:09.874976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:09.875715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:09.875989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:09.876283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:09.877641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:09.878964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:09.881072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 105/223] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:09.882019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.953837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 119/224] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:09.955766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:09.991117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a657ee-7422-44a6-a1a4-a1ae10045ee8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.028014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.028646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.028929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.029189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.029850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:10.030151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.031875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.040574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 106/225] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:10.045690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.073074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:10.091429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713bcd2-a9c9-4732-bb06-5084bc4e8690 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.133016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.133988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.134515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.135164 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.136898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=c169c40f2ced468893969de8c95a3cea) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:10.137211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.138705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.150991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 120/226] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:09 2022] GET /identity/v3/role_assignments?user.id=c169c40f2ced468893969de8c95a3cea&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:10.162943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:10.218313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97691dc5-10a0-40ea-9470-2d11e816bd85 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.259223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.260224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.260759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.261244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] PATH_INFO: `/v3/users/0be00de6cae1465ab2810240fb5e697d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.262611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] RBAC: Authorizing `identity:get_user(user_id=0be00de6cae1465ab2810240fb5e697d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.264293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.266969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 107/227] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:10 2022] GET /identity/v3/users/0be00de6cae1465ab2810240fb5e697d => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:10.272222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.274224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.411462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e151c-6ae3-4330-83f6-1652a7c5423b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.434002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:10.436075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4abf0c-876c-4d87-8b5f-088c141c9e2f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.456123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.456783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.457063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.457337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.473346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.473636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:10.473914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.474195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.474470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.475622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.477702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:10.479131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:10.479973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:10.480801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:10.481396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 121/228] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:10 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:10.484555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 108/229] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:10.486102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.486618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.506446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:10.619970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeed36-5a02-4c4d-9e99-db059b31a8e3 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.651863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c832d-cea6-41f5-9aa0-51190ca64612 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.683133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.683750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.684032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.684323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.685003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:10.685303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.687379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.696390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 122/230] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:10.709762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.723070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.723816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.724040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.724339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/0be00de6cae1465ab2810240fb5e697d/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.728020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] RBAC: Authorizing `identity:create_grant(project_id=848978d7bdcb45c2842d6de0c5b7f7c0, user_id=0be00de6cae1465ab2810240fb5e697d, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.729504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.755430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 109/231] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:10 2022] PUT /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/0be00de6cae1465ab2810240fb5e697d/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:13:10.838142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:10.860202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2e3af-bc1d-467e-958f-7d735d5a171f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:10.906566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:10.907365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:10.907645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:10.907918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] PATH_INFO: `/v3/users/0be00de6cae1465ab2810240fb5e697d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:10.910036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] RBAC: Authorizing `identity:get_user(user_id=0be00de6cae1465ab2810240fb5e697d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:10.911535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:10.913412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 123/232] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:10 2022] GET /identity/v3/users/0be00de6cae1465ab2810240fb5e697d => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:10.918765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:10.972198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:11.045448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc2835-22e8-4e0a-ad5a-5557f747912a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:11.091237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68be92-8bea-46a0-acc8-58827974e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:11.091878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68be92-8bea-46a0-acc8-58827974e817 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:11.092155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68be92-8bea-46a0-acc8-58827974e817 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:11.092476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68be92-8bea-46a0-acc8-58827974e817 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:11.093694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68be92-8bea-46a0-acc8-58827974e817 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:11.095140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68be92-8bea-46a0-acc8-58827974e817 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:11.096800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 110/233] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:10 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:11.105302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:11.239556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812a9b5-9fab-4c7d-b12a-876e4e238821 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:11.284355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273cff-0ac4-460c-adc7-11f38cbc4ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:11.285035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273cff-0ac4-460c-adc7-11f38cbc4ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:11.285315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273cff-0ac4-460c-adc7-11f38cbc4ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:11.285579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273cff-0ac4-460c-adc7-11f38cbc4ee5 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/0be00de6cae1465ab2810240fb5e697d/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:11.290290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05273cff-0ac4-460c-adc7-11f38cbc4ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=848978d7bdcb45c2842d6de0c5b7f7c0, user_id=0be00de6cae1465ab2810240fb5e697d, role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:11.291745 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05273cff-0ac4-460c-adc7-11f38cbc4ee5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:11.317309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 124/234] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:11 2022] PUT /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/0be00de6cae1465ab2810240fb5e697d/roles/f5ae841af58449728d99fd785708f1ae => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:11.831310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90882999-68bb-4b97-8b05-5ff843eb30af None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:11.831815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90882999-68bb-4b97-8b05-5ff843eb30af None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:11.831891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90882999-68bb-4b97-8b05-5ff843eb30af None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:11.833207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 111/235] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:11.843941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2bd40-0a1b-465e-acc3-8b176395895e None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:11.844395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2bd40-0a1b-465e-acc3-8b176395895e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:11.844547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2bd40-0a1b-465e-acc3-8b176395895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:11.873248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4cb2bd40-0a1b-465e-acc3-8b176395895e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:11.875425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4cb2bd40-0a1b-465e-acc3-8b176395895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:11.877820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:11.957062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 125/236] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:12.076235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c984c-d90d-43d4-8519-26aa9e1835e5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.076888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c984c-d90d-43d4-8519-26aa9e1835e5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.077891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c984c-d90d-43d4-8519-26aa9e1835e5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.079726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 112/237] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:12.085303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.085590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.085876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.107418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:12.109492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:12.195000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 126/238] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:12.257694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c984c-d90d-43d4-8519-26aa9e1835e5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:12.400305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c984c-d90d-43d4-8519-26aa9e1835e5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:12.410348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:12.443906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:12.444602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.444886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.445165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.463340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:12.468859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:12.469713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:12.470471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 113/239] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:12.477330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:12.543460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:12.551777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:12.588949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3e99e-89b3-40bf-b00f-1ed74df7abcb None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:12.624139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:12.625184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.625729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.626145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.626939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:12.627410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:12.629052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ea08-3e9f-48ea-847f-cc3b9cb23b46 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:12.637903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 127/240] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:12.640060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2b5-37f9-42b3-adaa-53f966c7da3b None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.640659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2b5-37f9-42b3-adaa-53f966c7da3b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.641101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e2b5-37f9-42b3-adaa-53f966c7da3b None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.642581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 128/241] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:12.647782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2b5-37f9-42b3-adaa-53f966c7da3b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:12.672886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae5a21-045c-4159-bdb9-ac6dec3ede7c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:12.715992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99643e6-45d7-4a36-b49a-508957bfb0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:12.716690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99643e6-45d7-4a36-b49a-508957bfb0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.717061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99643e6-45d7-4a36-b49a-508957bfb0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.717340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99643e6-45d7-4a36-b49a-508957bfb0a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.719350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99643e6-45d7-4a36-b49a-508957bfb0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:12.720946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99643e6-45d7-4a36-b49a-508957bfb0a8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:12.727222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 114/242] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:12.728704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.728994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.729321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.749007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:12.750432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:12.771430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e2b5-37f9-42b3-adaa-53f966c7da3b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:12.782148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:12.805019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:12.811955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:12.812904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.813321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.813766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] PATH_INFO: `/v3/users/e013fbaadba04741b9d1824014452669` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.828802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 115/243] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:12.829708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] RBAC: Authorizing `identity:get_user(user_id=e013fbaadba04741b9d1824014452669)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:12.829816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:12.831458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:12.833584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 129/244] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:12 2022] GET /identity/v3/users/e013fbaadba04741b9d1824014452669 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:12.839243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:12.939177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e37e1-e0c2-4acd-a237-a36404b9c16e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:12.946274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300d5cb-982e-4427-9931-4074a29e6512 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:12.976854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:12.977518 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:12.977795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:12.978113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:12.978759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:12.980318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:12.998410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:12.999985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.000549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.001011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.039105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 116/245] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:12 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:13.062100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:13.076055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:13.078167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:13.174445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.192086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 130/246] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:13:13.193436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.211433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:13.319232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bdca1-2814-492d-9963-e1d934ef1f54 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:13.319783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:13.334759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f76a4d-fa80-4705-a2c6-b70cad82fce9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:13.370302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4239c-99c9-48fb-b3d2-c6f212df2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:13.370947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4239c-99c9-48fb-b3d2-c6f212df2579 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.371225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4239c-99c9-48fb-b3d2-c6f212df2579 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.371496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4239c-99c9-48fb-b3d2-c6f212df2579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.385942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4239c-99c9-48fb-b3d2-c6f212df2579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:13.389727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:13.390380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.390663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.390939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.392083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-06b4239c-99c9-48fb-b3d2-c6f212df2579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:13.392551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:13.393402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:13.394194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:13.394805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:13.394871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 117/247] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:13.395406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff91e-b939-416e-964e-fccb1eb79fa4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.395510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 131/248] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:13 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:13.395579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff91e-b939-416e-964e-fccb1eb79fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.395772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff91e-b939-416e-964e-fccb1eb79fa4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.397429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 118/249] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:13.400771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff91e-b939-416e-964e-fccb1eb79fa4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.400910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.514211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:13.525203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39cfe9-e5e2-4505-93be-f42ad827081a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:13.538817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff91e-b939-416e-964e-fccb1eb79fa4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:13.566906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:13.567939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.568514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.568936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.570044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:13.570936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:13.573170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd8422-5e75-4245-87ba-28014dfab966 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:13.582996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:13.583606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.583906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.584148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.584908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] RBAC: Adding query filter params (role.id=011ebccde97b4885abd94a1a99e6923c, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=e013fbaadba04741b9d1824014452669) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:13.585309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:13.586350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 132/250] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:13.587735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.587850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:13.592436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.592681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.599232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 119/251] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:13 2022] GET /identity/v3/role_assignments?user.id=e013fbaadba04741b9d1824014452669&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=011ebccde97b4885abd94a1a99e6923c => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:13.600379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.619962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:13.621625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:13.637094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:13.713375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 133/252] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:13.744757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c09d6e-3065-4e29-bd95-b0024a826854 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:13.785066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:13.786115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.786611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.787078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] PATH_INFO: `/v3/users/c169c40f2ced468893969de8c95a3cea` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.788582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] RBAC: Authorizing `identity:get_user(user_id=c169c40f2ced468893969de8c95a3cea)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:13.790254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:13.792133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 120/253] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:13 2022] GET /identity/v3/users/c169c40f2ced468893969de8c95a3cea => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:13.798903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.907471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35101ea0-793a-4492-b3bc-3b5d239dd704 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:13.943607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafca671-beeb-45d0-aef1-2c84f19e3ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:13.944622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafca671-beeb-45d0-aef1-2c84f19e3ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:13.945119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafca671-beeb-45d0-aef1-2c84f19e3ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:13.945601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafca671-beeb-45d0-aef1-2c84f19e3ea5 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:13.946935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafca671-beeb-45d0-aef1-2c84f19e3ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:13.949050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafca671-beeb-45d0-aef1-2c84f19e3ea5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:13.951250 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 134/254] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:13 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:13.957656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:13.975926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:14.096879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac933a6-a641-4aba-a2c4-a9cafc74dfbc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:14.146824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf330-ada0-4906-81f5-2be6c54f8f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:14.147885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf330-ada0-4906-81f5-2be6c54f8f5f None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:14.148425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf330-ada0-4906-81f5-2be6c54f8f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:14.148900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf330-ada0-4906-81f5-2be6c54f8f5f None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/c169c40f2ced468893969de8c95a3cea/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:14.151032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf330-ada0-4906-81f5-2be6c54f8f5f None admin] RBAC: Authorizing `identity:create_grant(project_id=848978d7bdcb45c2842d6de0c5b7f7c0, user_id=c169c40f2ced468893969de8c95a3cea, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:14.152713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf330-ada0-4906-81f5-2be6c54f8f5f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:14.179136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 121/255] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:13 2022] PUT /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/c169c40f2ced468893969de8c95a3cea/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:13:14.224317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c638b42-5160-40b6-9d7b-a38776ccae74 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:14.224974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c638b42-5160-40b6-9d7b-a38776ccae74 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:14.225448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c638b42-5160-40b6-9d7b-a38776ccae74 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:14.227163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 135/256] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:14.233086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:14.234251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:14.234903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:14.259316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:14.259930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c638b42-5160-40b6-9d7b-a38776ccae74 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:14.261421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:14.304622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:14.363465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 122/257] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:14.486282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c638b42-5160-40b6-9d7b-a38776ccae74 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:14.521579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:14.522576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:14.523057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:14.523515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:14.538285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:14.543504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:14.544380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:14.545141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:14.547586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 136/258] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:14.553549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:14.557149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:14.683468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27dfad-4b17-4601-b0fd-81e7c48b756c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:14.728235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:14.728863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:14.729141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:14.729408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:14.730073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:14.730372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:14.731748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:14.743731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 123/259] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:14.752874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:14.907481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:14.949463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62edd4-dfb6-4a7e-b43f-8e498beefd70 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.019438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.020501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.020974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.021419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] PATH_INFO: `/v3/users/0be00de6cae1465ab2810240fb5e697d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.023117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] RBAC: Authorizing `identity:get_user(user_id=0be00de6cae1465ab2810240fb5e697d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:15.025441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:15.028383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 137/260] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:14 2022] GET /identity/v3/users/0be00de6cae1465ab2810240fb5e697d => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:15.036685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.078946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.130637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:15.195754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329aaf-0d01-4f41-a0d1-d79db50f3227 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.262066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.262606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.262889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.263165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.276722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40237a-be0d-498a-9ec0-ea95ee0b95a8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.341172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.341823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.342112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.342379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.364803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:15.370168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:15.371019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:15.371961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 138/261] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:15.377947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.381948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:15.393070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:15.394846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:15.507717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:15.535963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fff89-06d8-4389-a6c0-38d61a431dee None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.552851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 124/262] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:13:15.559001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.599134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.599856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.600131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.600454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.601124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:15.601422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:15.602989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:15.616580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 139/263] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:15.625508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.696958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:15.723095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9b83-8bbd-4dee-a47b-ff1316e87edb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.742741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4c48b-7797-4a06-a009-f95b4ef50014 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.781472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.782415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.782969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.783444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] PATH_INFO: `/v3/users/0be00de6cae1465ab2810240fb5e697d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.784880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] RBAC: Authorizing `identity:get_user(user_id=0be00de6cae1465ab2810240fb5e697d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:15.786878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:15.789401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.789637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 140/264] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/users/0be00de6cae1465ab2810240fb5e697d => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:15.794339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.794339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.794339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.795139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:15.796289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.797416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:15.799489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 125/265] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:15.831254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:15.896400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:15.915535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8822e7-8cc4-40d9-86c4-f840d8f49043 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:15.953096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:15.954763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:15.955243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:15.955715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:15.958602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:16.031631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:16.033853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:16.096725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277065-ff60-46c7-a347-08a1b9d2d1d9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:16.184894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 141/266] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:16.190946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:16.196982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:16.197607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.197887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.198163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.198898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=0be00de6cae1465ab2810240fb5e697d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:16.199203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:16.200661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a51fb0-1250-4380-af9e-9a094e30363b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:16.214539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 126/267] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:15 2022] GET /identity/v3/role_assignments?user.id=0be00de6cae1465ab2810240fb5e697d&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:16.276783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:16.358823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12fbc0-dad1-4e6b-b7bb-f3c6edcf432e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:16.407373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:16.408356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.408773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.409177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.410982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:16.413271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:16.415825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 142/268] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:16 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:16.423811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23080-b05e-4a50-bc18-cdf770a33bf8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.424093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23080-b05e-4a50-bc18-cdf770a33bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.424615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23080-b05e-4a50-bc18-cdf770a33bf8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.425383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:16.426342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 127/269] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:16.432543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fde67c-a59c-4140-86e9-397ca725f5f2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.433067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fde67c-a59c-4140-86e9-397ca725f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.433474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fde67c-a59c-4140-86e9-397ca725f5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.481187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-92fde67c-a59c-4140-86e9-397ca725f5f2 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:16.482711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-92fde67c-a59c-4140-86e9-397ca725f5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:16.547965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bbba1-4d5c-4f44-9794-c4ee5dbe91f8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:16.560603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:16.587771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:16.588414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.588694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.589098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.589900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] RBAC: Adding query filter params (role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=0be00de6cae1465ab2810240fb5e697d) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:16.590301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:16.591932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cef9c-4629-43e2-acfb-bdb01ca70ff8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:16.601098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 143/270] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:16 2022] GET /identity/v3/role_assignments?user.id=0be00de6cae1465ab2810240fb5e697d&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=f5ae841af58449728d99fd785708f1ae => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:16.602375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675128c-590c-4baf-9b18-60b2cc9040a7 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.612962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 128/271] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:16.616341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675128c-590c-4baf-9b18-60b2cc9040a7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.616341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675128c-590c-4baf-9b18-60b2cc9040a7 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.616559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 144/272] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:16 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:16.623260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe447f5-37e9-4bd6-8108-b981587072b2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.623911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe447f5-37e9-4bd6-8108-b981587072b2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.624424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe447f5-37e9-4bd6-8108-b981587072b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.650819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cfe447f5-37e9-4bd6-8108-b981587072b2 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:16.652404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cfe447f5-37e9-4bd6-8108-b981587072b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:16.679878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:16.732042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 129/273] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:16.818436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6ca1-73ca-4d98-8d11-039c24ae6239 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.818718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6ca1-73ca-4d98-8d11-039c24ae6239 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.818995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6ca1-73ca-4d98-8d11-039c24ae6239 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.820370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 145/274] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:16.825574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:16.825865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:16.826140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:16.849788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:16.851569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:16.922464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 130/275] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:17.008691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6ca1-73ca-4d98-8d11-039c24ae6239 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.039344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.128181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6ca1-73ca-4d98-8d11-039c24ae6239 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.151873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:17.165314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9c619-0574-40d1-a419-f301c23aae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.165953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30259d9-661b-4ae7-8e78-5e782bbd71ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.166055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c619-0574-40d1-a419-f301c23aae26 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.166226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c619-0574-40d1-a419-f301c23aae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.166503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c619-0574-40d1-a419-f301c23aae26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.178436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9c619-0574-40d1-a419-f301c23aae26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-2ce9c619-0574-40d1-a419-f301c23aae26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:17.183379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:17.184256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 146/276] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:17.189049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96648-6fa6-49b3-bc78-a93aff34c869 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.191537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96648-6fa6-49b3-bc78-a93aff34c869 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.191537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96648-6fa6-49b3-bc78-a93aff34c869 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.191537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 147/277] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:17.193380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.193658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.193927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.211022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.211313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:17.211654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.211930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.212198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.212524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:17.213321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:17.214760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:17.216488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 131/278] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:17.217167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.240161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:17.285457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 148/279] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:17.286272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.329366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe365d-bed1-46f4-bbf0-4b386cd7419a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.365698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.366538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.366965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.367398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.368196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:17.368661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:17.370190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:17.384909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 132/280] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:17.386047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.397676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749ad9-418b-427b-a88f-2e51f7beb947 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.408792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:17.434989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.435607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.435898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.436177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.437108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:17.438557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:17.468410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 149/281] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:17 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:17.468410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.486329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:17.514567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d31df2-8ede-4991-9ec1-fd8692f00965 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.554148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.554893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.555187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.555474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.567989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:17.574102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:17.575227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:17.576185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:17.580422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 133/282] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:17.581487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.597859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b550999-333e-49ab-bf8b-c791777cb960 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.637568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.637776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.638048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.638755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] PATH_INFO: `/v3/users/e013fbaadba04741b9d1824014452669` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.641568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] RBAC: Authorizing `identity:get_user(user_id=e013fbaadba04741b9d1824014452669)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:17.642500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:17.644356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 150/283] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/users/e013fbaadba04741b9d1824014452669 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:17.645185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.679472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:17.707428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286998-4781-4aa1-aa9a-0b8ca38a977a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.739629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:17.752825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.753717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.754133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.754563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.764219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49680-aa3d-4bbb-a5ce-3a29daa45b25 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.772917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:17.778859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:17.779767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:17.780615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 134/284] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:17.781288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.817070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.817699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.817973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.818243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.818918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:17.819220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:17.820642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:17.830581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 151/285] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:17.832067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.922130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9fb4-d08b-416e-924a-648669649358 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.969853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbfa45-a9bf-4621-b8b1-946d07118186 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:17.970021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:17.970455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:17.970743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:17.973218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:17.973324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:17.974902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:17.976654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 135/286] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:17.980836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:17.994792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:18.026285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:18.027708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:18.028510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:18.028934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:18.030589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:18.031596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:18.034137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:18.047411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 152/287] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:18.048792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:18.057118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:18.131387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a67589-23d6-4b54-9bf0-0f33857c0ba8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:18.171502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:18.172620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:18.172620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:18.172620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] PATH_INFO: `/v3/users/bd0651fef27b414ba921976db771f677` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:18.186918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] RBAC: Authorizing `identity:get_user(user_id=bd0651fef27b414ba921976db771f677)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:18.188209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7d06-bd69-4bba-bc71-bdcfabae5848 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:18.189507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:18.192605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 136/288] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:17 2022] GET /identity/v3/users/bd0651fef27b414ba921976db771f677 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:18.193894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:18.229594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:18.230178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:18.230454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:18.230724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/e013fbaadba04741b9d1824014452669/roles/011ebccde97b4885abd94a1a99e6923c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:18.232655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] RBAC: Authorizing `identity:create_grant(project_id=848978d7bdcb45c2842d6de0c5b7f7c0, user_id=e013fbaadba04741b9d1824014452669, role_id=011ebccde97b4885abd94a1a99e6923c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:18.234672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:18.250828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 153/289] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:18 2022] PUT /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/users/e013fbaadba04741b9d1824014452669/roles/011ebccde97b4885abd94a1a99e6923c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:18.251523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:18.298369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:18.338246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:18.378517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7156-bed8-44af-837a-b1ae5d04b132 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:18.390803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90decb-c1b6-4a5e-aa22-b2e7900805db None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:18.430223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:18.430896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:18.431177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:18.431449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:18.432205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, user.id=bd0651fef27b414ba921976db771f677, scope.system=all) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:18.432660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:18.434444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:18.442455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 154/290] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 17 19:13:18 2022] GET /identity/v3/role_assignments?user.id=bd0651fef27b414ba921976db771f677&scope.system=all&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:18.444821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:18.445925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:18.446390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:18.446813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] PATH_INFO: `/v3/users/c169c40f2ced468893969de8c95a3cea` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:18.454352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] RBAC: Authorizing `identity:get_user(user_id=c169c40f2ced468893969de8c95a3cea)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:18.455842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:18.457739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 137/291] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:18 2022] GET /identity/v3/users/c169c40f2ced468893969de8c95a3cea => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:18.463599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:18.610658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd832aa-1af7-4a47-bf0d-b45831b978d4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:18.641986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:18.651185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:18.651799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:18.652077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:18.652372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:18.731669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:18.733315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:18.879839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 155/292] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:18.885063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:19.049597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d29172-303c-4a61-ad09-41c7df47b32d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:19.095942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:19.102814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032ad5-ae87-4376-983e-95eea012869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:19.103470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032ad5-ae87-4376-983e-95eea012869b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:19.103753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032ad5-ae87-4376-983e-95eea012869b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:19.104026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032ad5-ae87-4376-983e-95eea012869b None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:19.106601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032ad5-ae87-4376-983e-95eea012869b None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:19.108238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032ad5-ae87-4376-983e-95eea012869b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:19.111195 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 138/293] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:18 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:19.118163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:19.169921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:19.266755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cf3b8-2be8-4321-9fb8-1c767b670865 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:19.317484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:19.318097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:19.318374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:19.318646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:19.319379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=c169c40f2ced468893969de8c95a3cea) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:19.319682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:19.321191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c1d16-c72f-4d4c-b5f5-b65633bbcb29 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:19.329880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 156/294] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:19 2022] GET /identity/v3/role_assignments?user.id=c169c40f2ced468893969de8c95a3cea&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:19.709773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b6c4-d760-4f48-9a4c-04f31106682f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:19.710737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b6c4-d760-4f48-9a4c-04f31106682f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:19.711193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b6c4-d760-4f48-9a4c-04f31106682f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:19.712881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 139/295] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:19.720873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126436-da38-4d0e-a25b-79f2fc57e8e9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:19.721214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126436-da38-4d0e-a25b-79f2fc57e8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:19.721431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126436-da38-4d0e-a25b-79f2fc57e8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:19.745018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-5e126436-da38-4d0e-a25b-79f2fc57e8e9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:19.746226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5e126436-da38-4d0e-a25b-79f2fc57e8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:19.834254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 157/296] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:20.069960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f34d2d-66f6-48a9-b4b0-da37a5243237 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.070597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f34d2d-66f6-48a9-b4b0-da37a5243237 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.071079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f34d2d-66f6-48a9-b4b0-da37a5243237 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.072743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 140/297] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:13:20.079415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.079699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.079967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.100287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:20.101755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:20.119832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:20.138334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f34d2d-66f6-48a9-b4b0-da37a5243237 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:20.179431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 158/298] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:20.251187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f34d2d-66f6-48a9-b4b0-da37a5243237 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:20.287504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:20.288144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.288447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.288720 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.299346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:20.305854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:20.306750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:20.307534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 141/299] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:20.317311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:20.422751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d57d2-5df1-41e6-a037-d990c18ace39 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:20.460612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:20.461636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.462128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.462595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.463515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:20.464010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:20.465644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:20.478347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 159/300] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:20.484066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:20.505491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:20.525794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:20.561018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:20.606959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e03b-a79d-4cc7-a6ec-dec896f754ef None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:20.624380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5239d2-9dd0-45a8-a7bf-29eb58b2f880 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:20.645409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043fb78-b7f7-4df8-b5c0-0e46d7141a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:20.646536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043fb78-b7f7-4df8-b5c0-0e46d7141a38 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.646817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043fb78-b7f7-4df8-b5c0-0e46d7141a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.647237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043fb78-b7f7-4df8-b5c0-0e46d7141a38 None admin] PATH_INFO: `/v3/users/28e039ca097949afb34fffb47f550e8c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.661689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043fb78-b7f7-4df8-b5c0-0e46d7141a38 None admin] RBAC: Authorizing `identity:get_user(user_id=28e039ca097949afb34fffb47f550e8c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:20.661942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:20.662564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.662840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.663109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.663220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043fb78-b7f7-4df8-b5c0-0e46d7141a38 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:20.664211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:20.665051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 142/301] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:20 2022] GET /identity/v3/users/28e039ca097949afb34fffb47f550e8c => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:20.665662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:20.672545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 160/302] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:20.672545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:20.672773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8e3cf-b4b2-4fdf-b6b3-3a29da89c02a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.672773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8e3cf-b4b2-4fdf-b6b3-3a29da89c02a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.672773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8e3cf-b4b2-4fdf-b6b3-3a29da89c02a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.673519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 143/303] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:20.674206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8e3cf-b4b2-4fdf-b6b3-3a29da89c02a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:20.766546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:20.779472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8e3cf-b4b2-4fdf-b6b3-3a29da89c02a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:20.785750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d73eb-6dd5-4b1b-9045-286b6535af36 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:20.796879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:20.813556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b47e3b-1425-4a65-b222-ceddefaf3f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:20.814092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b47e3b-1425-4a65-b222-ceddefaf3f5f None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.814370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b47e3b-1425-4a65-b222-ceddefaf3f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.814640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b47e3b-1425-4a65-b222-ceddefaf3f5f None admin] PATH_INFO: `/v3/groups` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.815251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b47e3b-1425-4a65-b222-ceddefaf3f5f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:20.816711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b47e3b-1425-4a65-b222-ceddefaf3f5f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:20.822899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:20.823558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.823793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.824075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.824830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] RBAC: Adding query filter params (role.id=011ebccde97b4885abd94a1a99e6923c, user.id=28e039ca097949afb34fffb47f550e8c, scope.system=all) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:20.825137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:20.826565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7e0b6-683a-464b-bb43-cc677a859d9b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:20.832636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 144/304] 10.222.0.62 () {60 vars in 1134 bytes} [Wed Aug 17 19:13:20 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:20.833048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 161/305] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 17 19:13:20 2022] GET /identity/v3/role_assignments?user.id=28e039ca097949afb34fffb47f550e8c&scope.system=all&role.id=011ebccde97b4885abd94a1a99e6923c => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:20.833951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cc400-c867-43d6-bdb4-76fda0b09fd2 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.834237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cc400-c867-43d6-bdb4-76fda0b09fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.834511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cc400-c867-43d6-bdb4-76fda0b09fd2 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.835953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 162/306] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:20.841663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.841890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:20.842065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.842139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:20.842442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.843142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:20.869964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:20.870530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:20.871240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:20.872310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:20.972452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 145/307] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:20.987805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 163/308] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:21.254235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.267000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.359634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:21.367320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350d236-030e-477b-b0bb-de625a9b1455 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.378238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:21.399447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5574026-3803-45ed-b26c-acee4f1d912d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.413284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.414282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.414758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.415274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:21.428462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:21.433638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:21.434480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:21.435251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 146/309] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:21.442164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.444279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.444929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.445212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.445491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:21.457293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:21.462292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:21.463165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:21.463949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 164/310] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:21.474056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.567943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143879-ab4c-45d2-879e-1680ab70c8af None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.601132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716746f8-16aa-400d-b7f9-23c0774d3d81 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.615233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.616005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.616315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.616644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:21.617306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:21.617971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:21.619682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:21.631310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 147/311] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:21.636705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.642692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.643309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.643593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.643868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:21.644566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:21.644871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:21.646247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:21.648870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:21.662834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 165/312] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:21.663775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.684070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:21.766155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428cd7-6e2b-4b85-8d5e-0ed2e8c760bc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.773602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23df1ab-4c02-46d9-8f20-ced7e6effa58 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.804607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.805971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.806495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.807082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] PATH_INFO: `/v3/users/e013fbaadba04741b9d1824014452669` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:21.808762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] RBAC: Authorizing `identity:get_user(user_id=e013fbaadba04741b9d1824014452669)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:21.810280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.810712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:21.811136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.812662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.813047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] PATH_INFO: `/v3/users/bd0651fef27b414ba921976db771f677` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:21.818161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 148/313] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/users/e013fbaadba04741b9d1824014452669 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:21.818814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] RBAC: Authorizing `identity:get_user(user_id=bd0651fef27b414ba921976db771f677)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:21.820315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:21.821414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.822267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 166/314] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/users/bd0651fef27b414ba921976db771f677 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:21.828969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:21.924971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:21.941355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:21.946838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e9126-c787-496d-8430-29ce8bda7791 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.965631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593ba8-e82a-4f05-ae3c-4c58ddca708b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:21.988940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:21.989903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:21.990456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:21.990921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.006007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:22.006614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.006898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.007176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] PATH_INFO: `/v3/system/users/bd0651fef27b414ba921976db771f677/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.008849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd0651fef27b414ba921976db771f677, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:22.010238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:22.020278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 167/315] 10.222.0.62 () {58 vars in 1334 bytes} [Wed Aug 17 19:13:21 2022] PUT /identity/v3/system/users/bd0651fef27b414ba921976db771f677/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:22.083269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:22.085162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:22.194007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:22.200448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 149/316] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:22.206159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:22.323022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e0d74-609b-4808-be74-905450a9d1e4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:22.356714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:22.362845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf552c1-84c2-4c12-8e05-b3fb3a5a2fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:22.363979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf552c1-84c2-4c12-8e05-b3fb3a5a2fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.364470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf552c1-84c2-4c12-8e05-b3fb3a5a2fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.364915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf552c1-84c2-4c12-8e05-b3fb3a5a2fb6 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.366444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf552c1-84c2-4c12-8e05-b3fb3a5a2fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:22.368101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf552c1-84c2-4c12-8e05-b3fb3a5a2fb6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:22.370307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 168/317] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:22 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:22.376174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:22.489426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e5e63-0a11-496c-97b6-a04c6c2c4b06 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:22.526255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:22.526875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.527159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.527437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.528168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] RBAC: Adding query filter params (role.id=011ebccde97b4885abd94a1a99e6923c, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0, user.id=e013fbaadba04741b9d1824014452669) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:22.528529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:22.530707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2423-8ad5-42d6-bf60-a3d3bdf2a1e6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:22.537248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 150/318] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:22 2022] GET /identity/v3/role_assignments?user.id=e013fbaadba04741b9d1824014452669&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=011ebccde97b4885abd94a1a99e6923c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:22.793428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a07fd-e40b-45a6-ba29-44c6b5740e62 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.793782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a07fd-e40b-45a6-ba29-44c6b5740e62 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.793992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a07fd-e40b-45a6-ba29-44c6b5740e62 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.795638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 169/319] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:22.800692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.800981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.801249 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.819632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:22.820836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:22.831003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4ab1f-22da-46b6-b0ea-f83c1e499bb8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.831290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4ab1f-22da-46b6-b0ea-f83c1e499bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.831562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4ab1f-22da-46b6-b0ea-f83c1e499bb8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.832925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 170/320] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:13:22.837763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:22.838051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:22.838311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:22.856588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:22.857789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:22.886197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:22.898012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 151/321] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:22.926908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 171/322] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:23.164410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:23.196400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:23.282028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f386b1b-d733-483b-b7bd-2503ec4e6a77 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:23.299873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65bc54-9113-4f2f-ab2a-6ded0924213d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:23.318263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:23.318890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:23.319166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:23.319434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:23.327855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:23.330905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:23.335915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:23.336998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:23.337979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:23.338725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:23.338725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:23.338725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:23.338725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:23.339304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:23.340351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 152/323] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:23.344659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:23.346085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:23.348281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 172/324] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:23.351481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:23.405573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:23.458335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c940-b0f4-41a0-83cf-3ff10e521f54 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:23.460665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23027db2-9810-4d8e-a64a-6d8b1807ef7c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:23.493435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:23.494044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:23.494324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:23.494596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:23.495251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:23.495443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:23.495553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:23.496054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:23.496363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:23.496636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] PATH_INFO: `/v3/groups` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:23.496952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:23.497249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:23.499187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:23.505953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 153/325] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:23.511566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:23.517323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 173/326] 10.222.0.62 () {60 vars in 1134 bytes} [Wed Aug 17 19:13:23 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:13:23.623125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e673-0596-49db-978f-10032ac5a7a7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:23.638868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:23.665241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691050cf-de4e-436a-a7e2-ae022a588ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:23.666151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691050cf-de4e-436a-a7e2-ae022a588ade None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:23.666436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691050cf-de4e-436a-a7e2-ae022a588ade None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:23.666718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691050cf-de4e-436a-a7e2-ae022a588ade None admin] PATH_INFO: `/v3/users/28e039ca097949afb34fffb47f550e8c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:23.667876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691050cf-de4e-436a-a7e2-ae022a588ade None admin] RBAC: Authorizing `identity:get_user(user_id=28e039ca097949afb34fffb47f550e8c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:23.669361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691050cf-de4e-436a-a7e2-ae022a588ade None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:23.670956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 154/327] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:23 2022] GET /identity/v3/users/28e039ca097949afb34fffb47f550e8c => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:23.676695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:23.742546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:23.793946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b41ae-04a3-4f12-9061-a1b87166a4fa None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:23.838820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22f20f-959f-4010-8255-b99b642106b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:23.839495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22f20f-959f-4010-8255-b99b642106b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:23.839773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22f20f-959f-4010-8255-b99b642106b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:23.840049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22f20f-959f-4010-8255-b99b642106b8 None admin] PATH_INFO: `/v3/system/users/28e039ca097949afb34fffb47f550e8c/roles/011ebccde97b4885abd94a1a99e6923c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:23.841544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22f20f-959f-4010-8255-b99b642106b8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28e039ca097949afb34fffb47f550e8c, role_id=011ebccde97b4885abd94a1a99e6923c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:23.842970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22f20f-959f-4010-8255-b99b642106b8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:23.851119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 174/328] 10.222.0.62 () {58 vars in 1334 bytes} [Wed Aug 17 19:13:23 2022] PUT /identity/v3/system/users/28e039ca097949afb34fffb47f550e8c/roles/011ebccde97b4885abd94a1a99e6923c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:24.083552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94097db-c8a4-4cb0-a9bd-8417b22bb97e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:24.084049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94097db-c8a4-4cb0-a9bd-8417b22bb97e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:24.084122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94097db-c8a4-4cb0-a9bd-8417b22bb97e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:24.085486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 155/329] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:24.090850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:24.091141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:24.091421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:24.113563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:24.114766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:24.190648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 175/330] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:24.488677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94097db-c8a4-4cb0-a9bd-8417b22bb97e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:24.606734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94097db-c8a4-4cb0-a9bd-8417b22bb97e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:24.653061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:24.653705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:24.653987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:24.654262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:24.669595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:24.676386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:24.677255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:24.678430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 156/331] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:24.683603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:24.743147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:24.800579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea739-dcac-42ac-b27b-74c01db6027b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:24.840024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:24.840726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:24.841009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:24.841281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:24.842123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:24.843146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:24.845311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:24.857816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 176/332] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:24.864345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:24.915038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:24.985017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0d07a-af3f-4d88-9053-ab2a5f1f0111 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:25.028462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf953f6-da60-4496-9706-18a0f9cac15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:25.029115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf953f6-da60-4496-9706-18a0f9cac15d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:25.029393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf953f6-da60-4496-9706-18a0f9cac15d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:25.029666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf953f6-da60-4496-9706-18a0f9cac15d None admin] PATH_INFO: `/v3/users/bd0651fef27b414ba921976db771f677` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:25.035216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf953f6-da60-4496-9706-18a0f9cac15d None admin] RBAC: Authorizing `identity:get_user(user_id=bd0651fef27b414ba921976db771f677)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:25.036753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf953f6-da60-4496-9706-18a0f9cac15d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:25.038731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 157/333] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:24 2022] GET /identity/v3/users/bd0651fef27b414ba921976db771f677 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:25.044697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:25.163770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b16ef5-e365-490a-8449-6e16bbcb683e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:25.177351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:25.199355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:25.199971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:25.200275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:25.200551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:25.201275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] RBAC: Adding query filter params (role.id=2714b27e089e443cb0f836617a1eb5b0, user.id=bd0651fef27b414ba921976db771f677, scope.system=all) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:25.201615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:25.203616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e2ad5-3535-453d-b1c5-6559ac0e92a1 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:25.216026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 177/334] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 17 19:13:25 2022] GET /identity/v3/role_assignments?user.id=bd0651fef27b414ba921976db771f677&scope.system=all&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:26.472515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333bd5b-05e4-45c9-8077-1906bd73f89a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:26.473572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333bd5b-05e4-45c9-8077-1906bd73f89a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:26.474059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333bd5b-05e4-45c9-8077-1906bd73f89a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:26.475879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 158/335] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:26.481262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370ceb-98a8-4cc9-9318-ac8ffb67c68c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:26.482126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370ceb-98a8-4cc9-9318-ac8ffb67c68c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:26.482624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370ceb-98a8-4cc9-9318-ac8ffb67c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:26.513486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-10370ceb-98a8-4cc9-9318-ac8ffb67c68c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:26.515615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-10370ceb-98a8-4cc9-9318-ac8ffb67c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:26.601831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 178/336] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:26.697878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2459-4c79-4f46-bf71-cbb9b4854199 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:26.698525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2459-4c79-4f46-bf71-cbb9b4854199 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:26.698995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2459-4c79-4f46-bf71-cbb9b4854199 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:26.700851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 159/337] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:26.706504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029f0a7-a33f-4940-8885-0d7d40463af6 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:26.706798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029f0a7-a33f-4940-8885-0d7d40463af6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:26.707080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029f0a7-a33f-4940-8885-0d7d40463af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:26.731321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-2029f0a7-a33f-4940-8885-0d7d40463af6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:26.732187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504603d-a4a3-4c48-a93e-a45286ad4196 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:26.732474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2029f0a7-a33f-4940-8885-0d7d40463af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:26.733476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504603d-a4a3-4c48-a93e-a45286ad4196 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:26.733965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504603d-a4a3-4c48-a93e-a45286ad4196 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:26.735713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 160/338] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:26.753135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c39e2-df4d-42d6-afa4-5d68969ef763 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:26.753723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c39e2-df4d-42d6-afa4-5d68969ef763 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:26.754188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c39e2-df4d-42d6-afa4-5d68969ef763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:26.792640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-713c39e2-df4d-42d6-afa4-5d68969ef763 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:26.794303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-713c39e2-df4d-42d6-afa4-5d68969ef763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:26.844073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 179/339] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:26.913938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 161/340] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 17 19:13:27.069073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5895ce-9fe2-46db-830f-c8535b24ff6b None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.069363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5895ce-9fe2-46db-830f-c8535b24ff6b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.069642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5895ce-9fe2-46db-830f-c8535b24ff6b None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.071186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 180/341] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:27.076344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.077155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.077428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.100995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:27.102178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:27.143771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:27.183282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 162/342] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:27.227941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5895ce-9fe2-46db-830f-c8535b24ff6b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.250394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.272805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:27.384471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5895ce-9fe2-46db-830f-c8535b24ff6b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:27.431432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398740f-7fda-4ad0-b6ad-14518fcd560a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:27.460521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:27.461161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.461435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.461702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.481413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:27.487861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:27.488788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:27.489586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:27.496282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:27.496282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.496282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.496282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.497391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 181/343] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:27.498501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.505649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:27.510640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:27.511512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:27.512334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 163/344] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:27.513682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.549029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:27.626875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b08f8-bb55-457a-b888-04aee41bfcb6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:27.632677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:27.641911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a4ef-5808-4630-8d64-ae8f604b542e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:27.663488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:27.664097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.664403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.664673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.665391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:27.665688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:27.667111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:27.676540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 164/345] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:27.677574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.681787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:27.682542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.682832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.683109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.695959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:27.701114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:27.702067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:27.702874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:27.704456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 182/346] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:27.705376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.785032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:27.801610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efda81-f2fd-4807-ae4e-d2e7dfdceb66 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:27.844165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:27.845141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.845424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.845697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.846360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:27.847105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:27.848497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:27.856527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54328ba-76b6-497c-9bd7-e50f4dc18df7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:27.860006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 165/347] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:27.860729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.901143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:27.902086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:27.902541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:27.903009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:27.921884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:27.928776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:27.929657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:13:27.930444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:27.931819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 183/348] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:27.932199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:27.950418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.004277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01aced4-9f00-4d22-9d81-aa6f7117f64c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:28.052862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:28.053547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.053930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.054303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.066259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6ffbb-3299-49dc-9922-d02d15401c1b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:28.084702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.114879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:28.114879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.114879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.115227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.115614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:28.118659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:28.118659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa052-42b9-4d2a-91f5-28fdc36a23b2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:28.132290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 184/349] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:28.132290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace2c13-da6a-48fb-80cd-6e6c04c1e38f None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.132290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace2c13-da6a-48fb-80cd-6e6c04c1e38f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.132290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace2c13-da6a-48fb-80cd-6e6c04c1e38f None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.132290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 185/350] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:28.132711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace2c13-da6a-48fb-80cd-6e6c04c1e38f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:28.155386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:28.157165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:28.220915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.261124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace2c13-da6a-48fb-80cd-6e6c04c1e38f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:28.281854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 166/351] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:28.283129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:28.307214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce8082-5dbb-4fc9-a074-4f02e5e1f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:28.307750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8082-5dbb-4fc9-a074-4f02e5e1f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.308029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8082-5dbb-4fc9-a074-4f02e5e1f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.308331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8082-5dbb-4fc9-a074-4f02e5e1f3e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.343792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.388693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8082-5dbb-4fc9-a074-4f02e5e1f3e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:28.390819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8082-5dbb-4fc9-a074-4f02e5e1f3e5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:28.402282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0b644-df1e-4aaf-9d5e-0a6f1b6ad444 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:28.444429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:28.445048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.445325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.445595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.446262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:28.446560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:28.447946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:28.458747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 167/352] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:28.459820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:28.474838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.513968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 186/353] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:28.515571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a70a-769d-4377-85d0-d3a2ddcd7248 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.515571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a70a-769d-4377-85d0-d3a2ddcd7248 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.515701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a70a-769d-4377-85d0-d3a2ddcd7248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.535395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9ba1a70a-769d-4377-85d0-d3a2ddcd7248 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:28.536624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9ba1a70a-769d-4377-85d0-d3a2ddcd7248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:28.592990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5702dac-96ee-4466-9e40-61e0a6f1c30e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:28.615056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.630206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 187/354] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:28.631253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826a62-dbb3-4321-a427-b6d509a5c1de None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.631543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826a62-dbb3-4321-a427-b6d509a5c1de None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.631809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826a62-dbb3-4321-a427-b6d509a5c1de None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.633113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 188/355] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:28.637787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826a62-dbb3-4321-a427-b6d509a5c1de None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:28.641273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:28.642003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.643835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.643835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.742431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:28.744551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:28.775906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826a62-dbb3-4321-a427-b6d509a5c1de None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:28.777597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.823772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:28.824708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:28.825165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:28.825580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:28.826905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:28.828982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:28.830852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 189/356] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:28 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:28.831788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:28.879256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 168/357] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:28.880048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:28.904403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:28.973297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f642095-d685-47a1-89f8-6cf84737c3b3 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.020272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07d88-2d2f-4f92-8081-fc68deb2d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.020777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07d88-2d2f-4f92-8081-fc68deb2d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.020898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2980b-9c6a-4d60-940b-8846bb345c90 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.021058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07d88-2d2f-4f92-8081-fc68deb2d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.021317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07d88-2d2f-4f92-8081-fc68deb2d8c6 None admin] PATH_INFO: `/v3/users/28e039ca097949afb34fffb47f550e8c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.022466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07d88-2d2f-4f92-8081-fc68deb2d8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=28e039ca097949afb34fffb47f550e8c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.023909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07d88-2d2f-4f92-8081-fc68deb2d8c6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.025642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 190/358] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:13:28 2022] GET /identity/v3/users/28e039ca097949afb34fffb47f550e8c => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.026898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.027178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.027520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.048553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:29.049751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:29.075427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.076071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.076380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.077307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.078801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.080276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.081978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 169/359] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:28 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.082762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.100605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:29.153645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 191/360] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:29.153645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.194923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:29.217751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbe2d1-88f2-4ad7-bf18-3c2cb4f80522 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.271034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99183745-367b-4eca-9505-3499e48e174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.274803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99183745-367b-4eca-9505-3499e48e174e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.274803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99183745-367b-4eca-9505-3499e48e174e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.274803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99183745-367b-4eca-9505-3499e48e174e None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.281969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99183745-367b-4eca-9505-3499e48e174e None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.283661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99183745-367b-4eca-9505-3499e48e174e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.285781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 170/361] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.286670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99183745-367b-4eca-9505-3499e48e174e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.288662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebc21-523e-4a0d-bba5-d10d086bf635 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.337127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.337824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.338155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.338423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.339639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.341317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.343784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 192/362] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.345285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.410960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:29.437270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99183745-367b-4eca-9505-3499e48e174e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.479146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.479852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.480132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.480442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.492794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:29.498177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:29.500612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 171/363] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:29.501946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.515059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:29.520139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1f15-6f9d-43ad-8396-6c2dc686331a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.583725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.587098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.587098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.587098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.587098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] RBAC: Adding query filter params (role.id=011ebccde97b4885abd94a1a99e6923c, user.id=28e039ca097949afb34fffb47f550e8c, scope.system=all) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:29.587098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.587439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.600959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 193/364] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/role_assignments?user.id=28e039ca097949afb34fffb47f550e8c&scope.system=all&role.id=011ebccde97b4885abd94a1a99e6923c => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.602115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.625976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaace4b-a2b2-4012-9274-3c510a00abc1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.674999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.675571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.675860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.676128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.677337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.678804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.680474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 172/365] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.686464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.740639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:29.750145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335af8e-3c31-499a-b652-b9fc827bc786 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.774162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:29.792913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.793530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.793804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.794070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.795101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:29.795101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.796659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.803570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 194/366] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.805444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81156-3b43-4c10-b6ec-e65be1450069 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:29.808790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.859523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:29.860186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:29.861911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:29.862197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:29.863497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:29.865110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:29.866903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 173/367] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:29.872621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:29.971210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b553a7-1e15-4c9a-a41e-46281184a4dc None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.019817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.020523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.020835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.021081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.024041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae27a6-b3e8-4d13-ac49-72b56c426929 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.041878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:30.062288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:30.063223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:30.064017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 195/368] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:30.064697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:30.079746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.081243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.081243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.081243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.081888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:30.082006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:30.083287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:30.093623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 174/369] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:30.094479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:30.100412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:30.110127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:30.190523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34461d93-e31a-4dcc-b291-5755c53ca2bb None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.219666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49932d-e6dc-4305-8f59-bb8d794a73d9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.226641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.227202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.227482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.227757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.228545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=6a35b03e050843e983b8cf7876ee349d) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:30.228931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:30.230278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:30.236626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 196/370] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:30 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:30.237424 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:30.274993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.275726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.276006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.276316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.277068 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=6a35b03e050843e983b8cf7876ee349d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:30.277633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:30.280916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:30.299240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 175/371] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:30 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=f5ae841af58449728d99fd785708f1ae => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:30.300575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:30.413380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:30.449847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d570b0-5f6d-4539-956b-cd3c37749e8d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.455468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:30.495306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1d7e-27cf-4c81-a350-87dc7f5bd3e7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.508438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.509352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.509625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.509905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.510838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:30.511616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:30.513331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:30.526733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 197/372] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:30.532998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:30.535649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.536289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.536578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.536859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.620827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:30.622773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:30.658557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd86a0-1662-4add-9b3c-99f064bfcb47 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:30.711255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:30.716555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:30.718172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:30.722680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:30.723181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:30.752570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:30.783327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 176/373] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:30.791828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:30.869687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:30.871589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:30.942070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ff469-6f2f-4c7e-bb4d-0193070b9954 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:31.013738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:31.014429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.014710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.014983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.016122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:31.017640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:31.019432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 177/374] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:30 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:31.026654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:31.047911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 198/375] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:31.054386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:31.116319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:31.136429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:31.212809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529ab8-1fd1-4b86-be2a-6133b972ea13 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:31.244064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45042e8-fc56-479c-ad18-3451120bea7c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:31.281147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:31.281796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.282076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.282347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] PATH_INFO: `/v3/projects/0fa6223fd0f04b6fb349808c655819e2` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.286392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa6223fd0f04b6fb349808c655819e2)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:31.287845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:31.296045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 199/376] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:31 2022] GET /identity/v3/projects/0fa6223fd0f04b6fb349808c655819e2 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:31.302429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:31.310218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:31.310927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.311214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.311495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.312839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:31.314272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:31.316362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 178/377] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:31 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:31.323968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:31.495297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b7691-e981-43f4-bfb3-11963f7a08f8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:31.520649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:31.534535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913002-0958-45d9-90c7-3e09b9e7b390 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:31.542601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:31.574786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da714a3f-ff0c-4d75-a361-4a0d5de1c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:31.576057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714a3f-ff0c-4d75-a361-4a0d5de1c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.576258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:31.577545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714a3f-ff0c-4d75-a361-4a0d5de1c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.577847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.578039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da714a3f-ff0c-4d75-a361-4a0d5de1c8a1 None admin] PATH_INFO: `/v3/groups/c9b4c5ab1cd94badb6397ca242de17a5` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.578712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.579232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.580133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:31.580712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:31.582351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:31.595593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 179/378] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:31 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=f5ae841af58449728d99fd785708f1ae => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:31.600997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714a3f-ff0c-4d75-a361-4a0d5de1c8a1 None admin] RBAC: Authorizing `identity:get_group(group_id=c9b4c5ab1cd94badb6397ca242de17a5)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:31.602732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da714a3f-ff0c-4d75-a361-4a0d5de1c8a1 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:31.604912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 200/379] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:31 2022] GET /identity/v3/groups/c9b4c5ab1cd94badb6397ca242de17a5 => generated 229 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:31.611313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:31.776616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98006efe-7b56-43fa-a1e1-a52f11563f33 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:31.831549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:31.832433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.832867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.833285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.834171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] RBAC: Adding query filter params (group.id=c9b4c5ab1cd94badb6397ca242de17a5, role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0fa6223fd0f04b6fb349808c655819e2) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:31.834649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:31.836235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f615ea0-922d-4bd3-93c1-ee53142599d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:31.843711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 180/380] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:31 2022] GET /identity/v3/role_assignments?group.id=c9b4c5ab1cd94badb6397ca242de17a5&scope.project.id=0fa6223fd0f04b6fb349808c655819e2&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:31.966873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece35cd-2e1c-4fc2-a05b-87302313e1e6 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.968232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece35cd-2e1c-4fc2-a05b-87302313e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.968973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece35cd-2e1c-4fc2-a05b-87302313e1e6 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:31.970512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 201/381] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:31.976153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84a7f-15e2-41cf-ba2b-3a5148a71143 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:31.976749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84a7f-15e2-41cf-ba2b-3a5148a71143 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:31.977225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84a7f-15e2-41cf-ba2b-3a5148a71143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.013096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cdc84a7f-15e2-41cf-ba2b-3a5148a71143 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:32.014686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cdc84a7f-15e2-41cf-ba2b-3a5148a71143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:32.044849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:32.090230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 181/382] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:32.513240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece35cd-2e1c-4fc2-a05b-87302313e1e6 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:32.656115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece35cd-2e1c-4fc2-a05b-87302313e1e6 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:32.695487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e45af7-54ae-4b59-bc6e-edd6d236fc46 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:32.695487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e45af7-54ae-4b59-bc6e-edd6d236fc46 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:32.695487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e45af7-54ae-4b59-bc6e-edd6d236fc46 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.696199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 182/383] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:32.700467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65cfba-9387-4974-aee9-27fe00094b16 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:32.700959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65cfba-9387-4974-aee9-27fe00094b16 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:32.701620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65cfba-9387-4974-aee9-27fe00094b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.710487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab51854-2488-4686-a45b-a7e02b2f64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:32.711135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51854-2488-4686-a45b-a7e02b2f64ad None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:32.711418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51854-2488-4686-a45b-a7e02b2f64ad None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:32.711690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51854-2488-4686-a45b-a7e02b2f64ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.723113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ef65cfba-9387-4974-aee9-27fe00094b16 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:32.723867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab51854-2488-4686-a45b-a7e02b2f64ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:32.724935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ef65cfba-9387-4974-aee9-27fe00094b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6ab51854-2488-4686-a45b-a7e02b2f64ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:32.728799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:32.729725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:32.730531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 202/384] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:32.731674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84689914-bc39-4db1-990b-05e848fefd81 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:32.731674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84689914-bc39-4db1-990b-05e848fefd81 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:32.731932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84689914-bc39-4db1-990b-05e848fefd81 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.738757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 203/385] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:32.743014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84689914-bc39-4db1-990b-05e848fefd81 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:32.779251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:32.822563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 183/386] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:32.824997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:32.825925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:32.826480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.848979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:32.850417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:32.859828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84689914-bc39-4db1-990b-05e848fefd81 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:32.897519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:32.898889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:32.899433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:32.899905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:32.900837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:32.901452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:32.903291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:32.912703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 204/387] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:32.923759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:32.963900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 184/388] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:33.057282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba21cde-de90-4c71-9672-713f110dea90 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.060606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:33.115262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.115902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.116183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.116485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.117605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:33.119034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:33.120920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 205/389] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:32 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:33.126875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.176792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:33.249708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.258439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0d31-029c-4463-9099-d0e106a8d993 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.303112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.304005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.304306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.304637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.306457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:33.308023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:33.310494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 185/390] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:33.312013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.369947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd929-2a3a-4e04-9e24-416112447da9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.409086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.410009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.410356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.410693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.422836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:33.428601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:33.429666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:33.430670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:33.431385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:33.432846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 206/391] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:33.434496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.448632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543bb4b-c484-48ef-870a-47bb8a22f341 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.465733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:33.504179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.505072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.505728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.506005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.522315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:33.528798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:33.530624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:33.531796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:33.534604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 186/392] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:33.536222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.556028 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894089-77a4-4bd7-87bd-5feadb5b981c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.595203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.596011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.596415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.596783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.599022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=848978d7bdcb45c2842d6de0c5b7f7c0, group_id=a22b67acdbe64aef986c9e049b6ee44c, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:33.600837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:33.623919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 207/393] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 17 19:13:33 2022] PUT /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:33.623919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.726853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0c11-6f44-4304-bb06-dee95b7f88b1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.772076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.772751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.773032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.773822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.775771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:33.775771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:33.778063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:33.789407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 187/394] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:33.795469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.815520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:33.846893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:33.872234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f65c-bc89-46e9-a61b-72790488f8b9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.923932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5e455-c500-4306-8f83-5f75e10a9242 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:33.962969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.963982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.964504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.964979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.966337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:33.968138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:33.969864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:33.970489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:33.970824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:33.971030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 188/395] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:33.971137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:33.971831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:33.972138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:33.973530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:33.975791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:33.987905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 208/396] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:33.997551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.082876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:34.104912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6e70f-bac9-4e9e-8e20-7a67c476a067 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:34.128775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379967f-f97c-40f7-a9d2-163f05bae1e5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:34.148914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e68705-2e84-46a9-b360-02265d2ce6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:34.150012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68705-2e84-46a9-b360-02265d2ce6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.150509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68705-2e84-46a9-b360-02265d2ce6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.151000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e68705-2e84-46a9-b360-02265d2ce6d4 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.153578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e68705-2e84-46a9-b360-02265d2ce6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:34.155808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e68705-2e84-46a9-b360-02265d2ce6d4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:34.159474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 189/397] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:34.160798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e927-f50d-4c2c-9329-0328aee507f9 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.161086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e927-f50d-4c2c-9329-0328aee507f9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.161354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e927-f50d-4c2c-9329-0328aee507f9 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.167941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 190/398] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:34.168873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e927-f50d-4c2c-9329-0328aee507f9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.178784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70229b-93d3-4a32-a856-f79ac698fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:34.179739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70229b-93d3-4a32-a856-f79ac698fb35 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.180219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70229b-93d3-4a32-a856-f79ac698fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.180723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70229b-93d3-4a32-a856-f79ac698fb35 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.182345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70229b-93d3-4a32-a856-f79ac698fb35 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:34.184010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70229b-93d3-4a32-a856-f79ac698fb35 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:34.191074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 209/399] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:33 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:34.192879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.193385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.193882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.213909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:34.215104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:34.227668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:34.292381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 210/400] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:34.293280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.294974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e927-f50d-4c2c-9329-0328aee507f9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:34.335251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2781-44f3-4fbe-b39d-3c70b45688ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:34.336168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2781-44f3-4fbe-b39d-3c70b45688ba None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.336628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2781-44f3-4fbe-b39d-3c70b45688ba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.337064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2781-44f3-4fbe-b39d-3c70b45688ba None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.339119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e2781-44f3-4fbe-b39d-3c70b45688ba None admin] RBAC: Authorizing `identity:create_grant(project_id=6a35b03e050843e983b8cf7876ee349d, group_id=a22b67acdbe64aef986c9e049b6ee44c, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:34.340740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e2781-44f3-4fbe-b39d-3c70b45688ba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:34.357428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 191/401] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 17 19:13:34 2022] PUT /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:34.359491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdfbde-8e54-4cec-8143-ad8cc182afcd None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.359956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdfbde-8e54-4cec-8143-ad8cc182afcd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.360801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdfbde-8e54-4cec-8143-ad8cc182afcd None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.367140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 192/402] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:34.369251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.369533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.369801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.392077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:34.392705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:34.396042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:34.434214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374bc42-b5ac-4ff3-927a-a668ac28b59b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:34.480293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 193/403] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:34.483117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007289-6733-49ef-be8b-8517379af937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:34.484106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007289-6733-49ef-be8b-8517379af937 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.484425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007289-6733-49ef-be8b-8517379af937 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.484759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007289-6733-49ef-be8b-8517379af937 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.485958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007289-6733-49ef-be8b-8517379af937 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:34.487412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007289-6733-49ef-be8b-8517379af937 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:34.493744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 211/404] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:34 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:34.495492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.619836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f7182-89fe-4771-8eab-bbc86d1f64f5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:34.631562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007289-6733-49ef-be8b-8517379af937 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.649100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:34.664592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:34.665587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.666077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.666557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.669393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] RBAC: Authorizing `identity:create_grant(project_id=6a35b03e050843e983b8cf7876ee349d, group_id=a22b67acdbe64aef986c9e049b6ee44c, role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:34.671101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:34.684074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:34.691671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 194/405] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 17 19:13:34 2022] PUT /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/f5ae841af58449728d99fd785708f1ae => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:34.765145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007289-6733-49ef-be8b-8517379af937 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:34.815171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:34.816169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:34.816687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:34.817205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:34.820897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.829685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:34.836140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:34.837073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:34.837845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 212/406] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:34.848907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:34.963118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:35.001984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1b5d2-02e6-4b3f-acda-a93f272ec49e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.012682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c5253-f967-4d56-85d8-38ac6fc4b9bd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.048220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.049334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.049755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.050581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.051435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:35.051897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.053979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.062176 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.063235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.063697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.064083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.065575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 213/407] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:35.070712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:35.078193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:35.087143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:35.088029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:35.088866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 195/408] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:35.094743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:35.217448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:35.253882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98e9c-bfd8-4239-9060-0d2efc0c19fb None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.301688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.302761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.303247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.303837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.305510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.307789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.310313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 214/409] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:35 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:35.316877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:35.322422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183114a8-5aff-4c47-9ba7-6ea4174b306d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.324549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:35.436978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.437604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.437885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.438153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.438826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:35.439124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.440519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.440790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a4d83-cdda-4f87-9d5d-dad250a26c1d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.458470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 196/410] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:35.463978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:35.484478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.486748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.487028 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.488163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.492287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.495804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.499736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 215/411] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:35 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:35.505623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:35.624737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb541ef-7e74-47ed-87a1-a89ca475f11e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.645179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:35.661839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:35.682579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.684210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.684568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.684842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] PATH_INFO: `/v3/groups/c9b4c5ab1cd94badb6397ca242de17a5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.688555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] RBAC: Authorizing `identity:get_group(group_id=c9b4c5ab1cd94badb6397ca242de17a5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.690035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.691767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 197/412] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:35 2022] GET /identity/v3/groups/c9b4c5ab1cd94badb6397ca242de17a5 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:35.697575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:35.707595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81bac-f938-4fbb-9a37-abfdd7b649ce None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.747120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.747702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.747979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.748884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.752023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=848978d7bdcb45c2842d6de0c5b7f7c0, group_id=a22b67acdbe64aef986c9e049b6ee44c, role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.753769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.777697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 216/413] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 17 19:13:35 2022] PUT /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0/groups/a22b67acdbe64aef986c9e049b6ee44c/roles/f5ae841af58449728d99fd785708f1ae => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:13:35.851172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db309-7b1b-47b7-a601-763cd7651d00 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:35.894683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa865c97-9f3e-4d39-a0d2-3911838dfe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:35.895694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865c97-9f3e-4d39-a0d2-3911838dfe5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:35.896187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865c97-9f3e-4d39-a0d2-3911838dfe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:35.896716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa865c97-9f3e-4d39-a0d2-3911838dfe5a None admin] PATH_INFO: `/v3/projects/0fa6223fd0f04b6fb349808c655819e2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:35.900969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865c97-9f3e-4d39-a0d2-3911838dfe5a None admin] RBAC: Authorizing `identity:get_project(project_id=0fa6223fd0f04b6fb349808c655819e2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:35.902668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa865c97-9f3e-4d39-a0d2-3911838dfe5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:35.905051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 198/414] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:35 2022] GET /identity/v3/projects/0fa6223fd0f04b6fb349808c655819e2 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:35.910501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:36.035118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0ea16-8bae-436a-8f9c-75f9e8f56b96 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:36.066217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:36.079426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f5b6-b999-438c-830c-20d4c8b569bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:36.080461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f5b6-b999-438c-830c-20d4c8b569bf None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:36.080946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f5b6-b999-438c-830c-20d4c8b569bf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:36.081417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f5b6-b999-438c-830c-20d4c8b569bf None admin] PATH_INFO: `/v3/projects/0fa6223fd0f04b6fb349808c655819e2/groups/c9b4c5ab1cd94badb6397ca242de17a5/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:36.085133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f5b6-b999-438c-830c-20d4c8b569bf None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa6223fd0f04b6fb349808c655819e2, group_id=c9b4c5ab1cd94badb6397ca242de17a5, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:36.088152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f5b6-b999-438c-830c-20d4c8b569bf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:36.106871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 217/415] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 17 19:13:35 2022] PUT /identity/v3/projects/0fa6223fd0f04b6fb349808c655819e2/groups/c9b4c5ab1cd94badb6397ca242de17a5/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:36.125028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c64ed-79cf-4bb5-8b1a-5ec49079da30 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:36.125530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c64ed-79cf-4bb5-8b1a-5ec49079da30 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:36.125613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c64ed-79cf-4bb5-8b1a-5ec49079da30 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:36.127316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 199/416] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:36.132630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa8648-bfd3-486d-91cb-7abd85a44204 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:36.133139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa8648-bfd3-486d-91cb-7abd85a44204 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:36.133572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa8648-bfd3-486d-91cb-7abd85a44204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:36.161449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-63aa8648-bfd3-486d-91cb-7abd85a44204 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:36.163024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-63aa8648-bfd3-486d-91cb-7abd85a44204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:36.265267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 218/417] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:36.623677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c64ed-79cf-4bb5-8b1a-5ec49079da30 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:36.704562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:36.768627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c64ed-79cf-4bb5-8b1a-5ec49079da30 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:36.836947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:36.837978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:36.838465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:36.838967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:36.854524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:36.858357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594e677-4c8d-4808-99dc-846513c567b4 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:36.858646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594e677-4c8d-4808-99dc-846513c567b4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:36.858923 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594e677-4c8d-4808-99dc-846513c567b4 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:36.860284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 219/418] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:36.862088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:36.862960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:36.863740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:36.866252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 200/419] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:36.870840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ca320-ed7e-4312-97f9-065c9fd1c019 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:36.870840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ca320-ed7e-4312-97f9-065c9fd1c019 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:36.870840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ca320-ed7e-4312-97f9-065c9fd1c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:36.872161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:36.903367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f65ca320-ed7e-4312-97f9-065c9fd1c019 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:36.906686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f65ca320-ed7e-4312-97f9-065c9fd1c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:37.055382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 220/420] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:37.068638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177450-7836-4f7d-85d6-9200246da7d9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.099607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:37.112091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c691-9c05-41d6-b56d-6739ce051425 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.112386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c691-9c05-41d6-b56d-6739ce051425 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.112666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c691-9c05-41d6-b56d-6739ce051425 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.117807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 221/421] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:13:37.125988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.126273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.126541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.128927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:37.130099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.130577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.131103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.131975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:37.132531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:37.134259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:37.152937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 201/422] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:37.162672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.164313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:37.165507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:37.270892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:37.310298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8b4d-bc65-4e86-9fdb-d06cc5f4a005 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.345922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:37.346531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.346811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.347084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.353904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 222/423] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:37.400027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:37.403299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.419312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:37.422012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:37.536563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 202/424] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:37.545895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.578673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ec9fb-5b93-4e1d-a800-13f46719bb41 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.626534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:37.627175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.628480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.628757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.650656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:37.656373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:37.657230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:13:37.658025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:37.663856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 223/425] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:37.668740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.695748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:37.717475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237990c-8425-4643-8a29-925ded5d503d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.722538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:37.758422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:37.759112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.759393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.759663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.760816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:37.762236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:37.764590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 203/426] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:37.765365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.791900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d79cf-655c-4c40-b0bd-4e8e8d41884f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.839904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:37.840880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.841226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.842427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.843917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] RBAC: Adding query filter params (name=member) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:37.844359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:37.845737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:37.861136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 224/427] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:37.862068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.888047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc29d89-f2e9-42b9-88d1-076c12c78e5e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.925771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:37.926402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:37.926678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:37.926950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:37.938262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:37.943435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:37.945813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:37.947794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:37.951091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 204/428] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:37.951091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:37.963594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:37.969133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbecc2-b9f3-4bd0-8255-3180e0448eff None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:37.973632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.012480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.013126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.013597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.014586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.016109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.017593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.020361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 225/429] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.021146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.080434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936206-aa7d-4ec3-a88f-fbae788810d5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.128329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d0d2a-5026-4617-aa79-fcccf4b72d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.128954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0d2a-5026-4617-aa79-fcccf4b72d7b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.129488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0d2a-5026-4617-aa79-fcccf4b72d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.129488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0d2a-5026-4617-aa79-fcccf4b72d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.139030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89be6f-0cc3-45fe-bf67-8d8ffd5344e2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.175375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.175983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.176275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.176555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.177304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:38.177511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.178874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.192283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 226/430] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.192283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.207563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d0d2a-5026-4617-aa79-fcccf4b72d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.208971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d0d2a-5026-4617-aa79-fcccf4b72d7b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.219679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.225955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.300515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b81d8-dd39-4014-94c8-2788162c261a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.312828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 205/431] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:38.314077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef47f-30ff-4776-95c5-bf9394e4da84 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.314360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef47f-30ff-4776-95c5-bf9394e4da84 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.314631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef47f-30ff-4776-95c5-bf9394e4da84 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.316005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 206/432] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:38.319989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef47f-30ff-4776-95c5-bf9394e4da84 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.346457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.347071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.347350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.347621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.348439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:38.348749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.350187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.364266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 227/433] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.364266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.445541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef47f-30ff-4776-95c5-bf9394e4da84 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.459024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.484955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.488500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cd115-4428-4f9b-893a-df295e52352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.489133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd115-4428-4f9b-893a-df295e52352c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.489410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd115-4428-4f9b-893a-df295e52352c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.489681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd115-4428-4f9b-893a-df295e52352c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.489788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2eb6-74b1-4fcc-88eb-4792a9fedb3d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.529975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a42c85-ce82-45b8-98f7-92bf934fa735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.530614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a42c85-ce82-45b8-98f7-92bf934fa735 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.530887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a42c85-ce82-45b8-98f7-92bf934fa735 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.531154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a42c85-ce82-45b8-98f7-92bf934fa735 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.532988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a42c85-ce82-45b8-98f7-92bf934fa735 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.534438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a42c85-ce82-45b8-98f7-92bf934fa735 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.536077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 228/434] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.538011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b6bc-eced-405f-9d7b-5cd1500fad61 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.538193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b6bc-eced-405f-9d7b-5cd1500fad61 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.538457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b6bc-eced-405f-9d7b-5cd1500fad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.559757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-57d9b6bc-eced-405f-9d7b-5cd1500fad61 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:38.561524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-57d9b6bc-eced-405f-9d7b-5cd1500fad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:38.570073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cd115-4428-4f9b-893a-df295e52352c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.571395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cd115-4428-4f9b-893a-df295e52352c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.633767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 229/435] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:38.635417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862ca8-dfbf-4589-bc5c-d79a88ea932d None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.635704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862ca8-dfbf-4589-bc5c-d79a88ea932d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.635973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862ca8-dfbf-4589-bc5c-d79a88ea932d None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.637235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 230/436] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:38.637911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862ca8-dfbf-4589-bc5c-d79a88ea932d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.683905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 207/437] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:38.687837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.688118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.688414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.707177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:38.708392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:38.710372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.747340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.755635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862ca8-dfbf-4589-bc5c-d79a88ea932d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.782856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 208/438] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:38.783820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.802376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.803716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.804228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.804726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.806623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.808831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.812097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 231/439] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.818666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.916908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce69e3d-3792-4ead-88c9-30a93ed95783 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.932774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794246f5-fe1a-4956-b497-0588b9a27374 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:38.955579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.956471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.957046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.957473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] PATH_INFO: `/v3/projects/6a35b03e050843e983b8cf7876ee349d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.958787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=6a35b03e050843e983b8cf7876ee349d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.960679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.962226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 209/440] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/projects/6a35b03e050843e983b8cf7876ee349d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.963078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:38.973447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:38.974048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:38.974325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:38.974592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:38.975310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=2714b27e089e443cb0f836617a1eb5b0, scope.project.id=6a35b03e050843e983b8cf7876ee349d) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:38.975849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:38.976238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:38.977895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:38.995515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 232/441] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=2714b27e089e443cb0f836617a1eb5b0 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:38.996868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.042182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.106928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7918388-d6dd-4cb8-9106-8876cc9dc6a5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.118977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e2164-00c3-4a6d-8362-24c65e86dd79 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.146621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.147304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.147616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.148352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.159640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.160320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.160602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.160875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.162868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:39.164352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:39.165960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 233/442] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:39.166740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.166958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:39.173079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:39.174006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:39.175591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:39.178084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 210/443] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:39.179090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.296043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.328116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.339837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc323-9451-4f5b-b60b-cbc02b6f5e74 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.340637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1986d-91d3-4f7c-919f-3f89648294e1 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.384566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.384813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.385175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.385284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.385448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.385566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.385715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.385956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.386483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=6a35b03e050843e983b8cf7876ee349d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:39.386789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:39.388226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:39.394537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 211/444] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=6a35b03e050843e983b8cf7876ee349d&role.id=f5ae841af58449728d99fd785708f1ae => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:39.395315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.397142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:39.402592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:39.403547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:39.405612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 234/445] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:39.409714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.530219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff4ff-5879-48a8-bc80-914b04ea0926 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.555409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0d5db-b1a2-456f-ba4c-81b4717eec87 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.570414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.576021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.577760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.578714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.579000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.579731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:39.580040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:39.584001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:39.595924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 212/446] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:39.602348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.606277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.606902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.607186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.607748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.608276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:39.608606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:39.610012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:39.618983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 235/447] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:39.624910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.646234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.717728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a3dbc-ac46-498e-8017-2c83845fd140 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.743932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b712b3-3de3-4bed-adf6-d6709e68d7ee None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:39.762294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.763026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.763344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.763591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.784068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:39.784718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:39.784986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:39.785255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:39.835329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.846671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:39.848649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:39.868676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:39.870141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:39.892604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:39.962869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 213/448] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:39.968858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:39.984886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 236/449] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:13:39.990458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:40.066294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:40.075214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffcb69-8727-472c-b430-9c9ea5c52c59 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:40.088925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814750-f12f-4403-afc5-233ac298c7a2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:40.105486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:40.109351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:40.109980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:40.110260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:40.110529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] PATH_INFO: `/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:40.111639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] RBAC: Authorizing `identity:get_project(project_id=848978d7bdcb45c2842d6de0c5b7f7c0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:40.113097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:40.114705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 214/450] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/projects/848978d7bdcb45c2842d6de0c5b7f7c0 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:40.120039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:40.128301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:40.129013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:40.129318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:40.129614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] PATH_INFO: `/v3/projects/0fa6223fd0f04b6fb349808c655819e2` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:40.130837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa6223fd0f04b6fb349808c655819e2)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:40.132478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:40.134195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 237/451] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:13:39 2022] GET /identity/v3/projects/0fa6223fd0f04b6fb349808c655819e2 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:40.140283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:40.220447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c652-a283-43a6-bcb1-9dda28c7efa5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:40.237445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1415b-5cdc-417a-ac7c-9c4471158597 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:40.253773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:40.254405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:40.254684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:40.254963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] PATH_INFO: `/v3/groups/a22b67acdbe64aef986c9e049b6ee44c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:40.256069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] RBAC: Authorizing `identity:get_group(group_id=a22b67acdbe64aef986c9e049b6ee44c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:40.257527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:40.259098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 215/452] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:40 2022] GET /identity/v3/groups/a22b67acdbe64aef986c9e049b6ee44c => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:40.265429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:40.271724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:40.272385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:40.272664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:40.272933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] PATH_INFO: `/v3/groups/c9b4c5ab1cd94badb6397ca242de17a5` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:40.274035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] RBAC: Authorizing `identity:get_group(group_id=c9b4c5ab1cd94badb6397ca242de17a5)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:40.275467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:40.277031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 238/453] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 17 19:13:40 2022] GET /identity/v3/groups/c9b4c5ab1cd94badb6397ca242de17a5 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:40.283079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:40.293592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:40.337825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:40.367160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd64e-7892-43e8-b17e-98f148299c47 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:40.383341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee9a2-ba6f-44ed-b28d-d0079815573d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:40.401665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:40.402264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:40.402540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:40.402811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:40.403531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] RBAC: Adding query filter params (group.id=a22b67acdbe64aef986c9e049b6ee44c, role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:40.403839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:40.405379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958012d0-967e-45f9-9983-92c92fafd892 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:40.411512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 216/454] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:40 2022] GET /identity/v3/role_assignments?group.id=a22b67acdbe64aef986c9e049b6ee44c&scope.project.id=848978d7bdcb45c2842d6de0c5b7f7c0&role.id=f5ae841af58449728d99fd785708f1ae => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:40.416587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:40.417212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:40.417494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:40.417769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:40.418510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] RBAC: Adding query filter params (group.id=c9b4c5ab1cd94badb6397ca242de17a5, role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0fa6223fd0f04b6fb349808c655819e2) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:40.418815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:40.420955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efd0d6-9594-4e86-82c1-521ed3db9381 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:40.430192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 239/455] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 17 19:13:40 2022] GET /identity/v3/role_assignments?group.id=c9b4c5ab1cd94badb6397ca242de17a5&scope.project.id=0fa6223fd0f04b6fb349808c655819e2&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:42.953837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c737b-5035-4b52-912a-0278bdca9ecf None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:42.954349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c737b-5035-4b52-912a-0278bdca9ecf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:42.954422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c737b-5035-4b52-912a-0278bdca9ecf None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:42.956126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 217/456] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:42.961982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:42.962395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:42.962528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:42.974043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66a55-7fa8-4fe7-9cb2-a7ee746c172b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:42.974722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66a55-7fa8-4fe7-9cb2-a7ee746c172b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:42.975195 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66a55-7fa8-4fe7-9cb2-a7ee746c172b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:42.977028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 218/457] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:42.982600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:42.983140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:42.983630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:42.984871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:42.986342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:43.021235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:43.022439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:43.066759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 240/458] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:43.142487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 219/459] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:43.363791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:43.427342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:43.464033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:43.494207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb86bf-d1f4-4137-9c67-f9d5fe917ad9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:43.525002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:43.532960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:43.533888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.534362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.534849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.545974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:43.547847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-4b16de1e-15ce-45b4-a88f-01c24c203159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:43.564002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:43.565360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:43.566184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:43.566184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:43.566184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:43.568223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 241/460] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:43.569874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9c01-1de5-4484-90b0-b74b91829a25 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.570355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9c01-1de5-4484-90b0-b74b91829a25 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.570890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9c01-1de5-4484-90b0-b74b91829a25 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.572774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 242/461] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:43.573727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab9c01-1de5-4484-90b0-b74b91829a25 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:43.628837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c344e5-8551-4e70-a41f-193090b04639 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:43.675058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:43.676052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.676589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.677059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.687762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:43.689494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:43.695007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:43.701075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab9c01-1de5-4484-90b0-b74b91829a25 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e46d0219-155f-4669-a897-2f5f3aadf7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:43.706633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:43.707498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:43.708348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:43.708348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:43.708348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:43.710334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 220/462] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:43.711694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448506ad-b6f2-4016-9733-4f0b1423bc2f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.712226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448506ad-b6f2-4016-9733-4f0b1423bc2f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.712733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448506ad-b6f2-4016-9733-4f0b1423bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.731779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-448506ad-b6f2-4016-9733-4f0b1423bc2f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:43.733943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-448506ad-b6f2-4016-9733-4f0b1423bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:43.749710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:43.750332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.750612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.750885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.751533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:43.751839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:43.753258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:43.768448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 243/463] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:43.768448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:43.809108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 221/464] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:43.820438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf562697-e91d-4266-bc25-764b21559a3e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.820438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf562697-e91d-4266-bc25-764b21559a3e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.820438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf562697-e91d-4266-bc25-764b21559a3e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.820438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 222/465] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:43.820438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf562697-e91d-4266-bc25-764b21559a3e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:43.822455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:43.907117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc6ee-4d6c-4dc0-98a9-13cba625d5b5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:43.934372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf562697-e91d-4266-bc25-764b21559a3e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:43.944172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:43.944919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.945295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.945665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.946467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:43.946861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:43.948461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48f1d3-fe15-4b7c-93be-751cef2a9028 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:43.962376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 244/466] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:43.963750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.964135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.964528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.982791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:43.983474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:43.983773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:43.984063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:43.984796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:43.987269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:43.990594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:43.991875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:44.024274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:44.024461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 223/467] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:43 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:44.024461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:44.133730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 245/468] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:44.135048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:44.147475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:44.225847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f1a2-b15f-47a7-a94e-62444c1fa871 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:44.276089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:44.276793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.277076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.277346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.278544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:44.280397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:44.291560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fccb04-3dfa-4b01-b7d6-34c18565f9cd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:44.312590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 224/469] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:44 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:44.339777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:44.340471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.340793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.341070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.353635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:44.355146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:44.376879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:44.377828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:44.378640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:44.378640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:44.378640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:44.378640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 246/470] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:44.384324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:44.450015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:44.454031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:44.510891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568039b-f19f-4f20-a839-5786070d0050 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:44.529875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:44.549171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:44.550395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.550395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.550395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.550951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:44.551250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:44.552637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c0857-94a6-4410-9d41-4adc6f57e4e0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:44.573654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 225/471] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:44.575680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921040a0-e2d5-4048-baa9-7efe1d90c3ed None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.576041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921040a0-e2d5-4048-baa9-7efe1d90c3ed None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.577131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921040a0-e2d5-4048-baa9-7efe1d90c3ed None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.579341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 226/472] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:44.580500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921040a0-e2d5-4048-baa9-7efe1d90c3ed None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:44.590644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f186-41e6-4950-a11d-47e5cc4b1d7b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:44.631213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:44.632279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.632760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.633229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.645748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:44.647466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8ab450da-68b4-453d-b381-eceaba1c5057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:44.663629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:44.664652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:44.665482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:44.665482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:44.665482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:44.665482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 247/473] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:44.666379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.666666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.666933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.695002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:44.696320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:44.700699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921040a0-e2d5-4048-baa9-7efe1d90c3ed None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:44.746663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:44.747573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.748935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.749676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.750968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:44.752844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:44.752987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:44.776681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 248/474] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:44.778005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:44.786451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 227/475] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:44 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:44.908929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722c3b0-f43a-4d15-8744-40de6f072d31 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:44.956101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:44.957105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:44.957610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:44.958119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:44.958950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:44.959438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:44.961013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:44.973815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 249/476] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:44.979357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:45.027308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:45.102439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a815f3-e447-4acc-97fd-482cc305565f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:45.139302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:45.140354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:45.140859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:45.141315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:45.142129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:45.143753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:45.151973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:45.172203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 228/477] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:44 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:45.217164 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:45.285269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa001-739b-4383-a1fc-86ede1e85eda None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:45.325424 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:45.326203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:45.327168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:45.327503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:45.328181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:45.329965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:45.338671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.sql.core [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 19:13:45.338671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 19:13:45.338671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [parameters: {'id': '25ec2f312e654803aa1cad5a620c664d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 19:13:45.338671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81674) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result.read() Aug 17 19:13:45.356038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:13:45.356973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application yield resource Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise self.value Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application session.commit() Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 19:13:45.358719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.session.flush() Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application compat.raise_( Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 19:13:45.360820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:13:45.362872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result.read() Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:13:45.364829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [parameters: {'id': '25ec2f312e654803aa1cad5a620c664d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:45.366515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 19:13:45.368506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:45.375415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 250/478] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 17 19:13:45 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:45.375556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:45.474150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:45.488294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b9d9-7c48-4888-8978-e8879113eca4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:45.524047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15daf7-ac40-4517-b2bc-94350bff4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:45.524691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15daf7-ac40-4517-b2bc-94350bff4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:45.524973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15daf7-ac40-4517-b2bc-94350bff4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:45.525246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15daf7-ac40-4517-b2bc-94350bff4fb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:45.536664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15daf7-ac40-4517-b2bc-94350bff4fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8e15daf7-ac40-4517-b2bc-94350bff4fb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:45.541883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:45.542728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:13:45.543509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:45.546828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 229/479] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:45.553347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:45.667708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf0266-cdea-4e4a-b59e-a5ef91cfaf14 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:45.678529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:45.707691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:45.708368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:45.708652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:45.708927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:45.709590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:45.709890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:45.711266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42c962-fec6-423c-8a12-9322dad5277d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:45.721144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 251/480] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:46.711627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ae62-0b64-46e1-bd5f-a7504f904bbf None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:46.712144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ae62-0b64-46e1-bd5f-a7504f904bbf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:46.712144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ae62-0b64-46e1-bd5f-a7504f904bbf None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:46.713797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 230/481] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:46.719114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:46.719567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:46.719654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:46.738362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:46.739562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:46.772358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ed116-5586-472f-bbaf-1dcd6a68b992 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:46.772658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ed116-5586-472f-bbaf-1dcd6a68b992 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:46.772904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ed116-5586-472f-bbaf-1dcd6a68b992 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:46.774468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 231/482] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:46.779355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:46.779618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:46.779893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:46.809253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:46.811091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:46.812683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 252/483] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:46.930459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 232/484] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:13:47.266440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:47.346353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:47.397362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fba4f-f680-432d-a875-a21dffc5f4ea None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:47.400411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:47.441988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0234b9a-1cd0-4d65-b128-16d3d2b6bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:47.442645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234b9a-1cd0-4d65-b128-16d3d2b6bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.442922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234b9a-1cd0-4d65-b128-16d3d2b6bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.443191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234b9a-1cd0-4d65-b128-16d3d2b6bfa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.460231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0234b9a-1cd0-4d65-b128-16d3d2b6bfa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-d0234b9a-1cd0-4d65-b128-16d3d2b6bfa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:47.466738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:47.468337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:47.469131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:47.469729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:47.469801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 253/485] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:47.471085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252311-ba4d-4756-8ead-346ed1bff3f1 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.471289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252311-ba4d-4756-8ead-346ed1bff3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.471557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252311-ba4d-4756-8ead-346ed1bff3f1 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.477184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 254/486] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:47.478922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9252311-ba4d-4756-8ead-346ed1bff3f1 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:47.510560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326bce9-6825-4466-9dab-83c12b423c55 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:47.550474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b575a-c764-4220-8da8-70474aa9a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:47.551104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b575a-c764-4220-8da8-70474aa9a51e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.551379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b575a-c764-4220-8da8-70474aa9a51e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.551647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b575a-c764-4220-8da8-70474aa9a51e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.562981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b575a-c764-4220-8da8-70474aa9a51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a77b575a-c764-4220-8da8-70474aa9a51e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:47.568007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:47.568906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:47.569678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 233/487] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:47.570987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.571265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.571535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.593704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:47.595736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:47.614974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9252311-ba4d-4756-8ead-346ed1bff3f1 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:47.653314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:47.655903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.655903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.655903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.655903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:47.656210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:47.657562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:47.672272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 255/488] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:47.672272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:47.695402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 234/489] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:47.696754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:47.706490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:47.786260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:47.827299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4505ea-ee5c-4d2c-b7b2-d3b9e3f9df9d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:47.867033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:47.867968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.868834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.868834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.871965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a3c99-4602-40d1-be58-4d5fa473c386 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:47.888527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:47.891070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-13a26a60-8bb7-4f00-b4c0-9e6d2a947890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:47.914891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:47.915824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:47.916705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:47.916705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:47.916705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:47.920328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 235/490] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:47.921761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb77b3b-e04b-421a-906c-5e4f74a43fc3 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.922231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb77b3b-e04b-421a-906c-5e4f74a43fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.922622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb77b3b-e04b-421a-906c-5e4f74a43fc3 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.924041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 236/491] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:47.924848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:47.925633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.926063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.926471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.927273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:47.927723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:47.929251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462243b-0c85-4d35-a98e-9e94e00b4064 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:47.930148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb77b3b-e04b-421a-906c-5e4f74a43fc3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:47.944324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 256/492] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:47.946438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:47.946874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:47.947323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:47.971898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:47.974115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:48.062847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb77b3b-e04b-421a-906c-5e4f74a43fc3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.065721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 257/493] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:48.066724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.083141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.097317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.116561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.118111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.118567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.119006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.120202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:48.120701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.122564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.138503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 237/494] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:48.139561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.194497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeea4a-32b8-48a8-b3d4-61d333712c19 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.238911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.239934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.240510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.241035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.260032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.262172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.268643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64f89-474f-4541-874c-c479653acab1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:48.283276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:48.284196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:48.285042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:48.285042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:48.285042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:48.285042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 258/495] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:48.286596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.319152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.320085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.320634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.321129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.332822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:48.338018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:48.338860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:48.339636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:48.347484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 238/496] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:48.348713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.372365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.391986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.411909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7379e5-13a1-4de8-b508-1c2c9195c3ce None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.446901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.447530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.447873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.448149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.450961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f302df-90ec-4e30-a6e6-f572d767e8fa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.456495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.457934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:48.470848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:48.471762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 259/497] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:48.472703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.491006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.491620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.491903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.492317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.492851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:48.493159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.494517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.506154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 239/498] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:48.506935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.581545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c45aa7-66e1-4454-8127-fd1890f1514d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.605765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.609017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d2543-dd20-4499-9b1b-2ab590975b08 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.611121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.620492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.621102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.621377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.621711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.622302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:48.622600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.623976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea83a2b-c284-4df6-a713-7758b91d62d4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.631978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 260/499] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:48.633166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5825-ac02-4a80-a42a-b58f6eb9576a None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.633454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5825-ac02-4a80-a42a-b58f6eb9576a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.633728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5825-ac02-4a80-a42a-b58f6eb9576a None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.634920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 261/500] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:48.635608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5825-ac02-4a80-a42a-b58f6eb9576a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.648543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.649312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.649631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.649948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.661387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:48.667928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:48.668871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:48.669650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 240/501] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:48.670555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.740187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5825-ac02-4a80-a42a-b58f6eb9576a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.773338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.773498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300cfdc-f015-4c32-8c15-13099fd0b72d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.773939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.774218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.774490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.775217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:48.775521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.776973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.805966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.806579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.806854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.807121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.814061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 262/502] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:48.814893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.815425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.817039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e246f2ba-ede9-4ba7-8f51-9a06fa1de036 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:48.830399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:48.831422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:48.832338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 241/503] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:48.833194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.833194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.833194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.850731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:48.851920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:48.865779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.868725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:48.920959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 242/504] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:48.921784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:48.922420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559013-c967-4775-9265-8fd737c7674f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:48.960375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:48.961351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:48.961655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:48.961930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:48.972368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:48.973839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:48.989437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:48.990336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:48.991152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:48.991152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:48.991152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:48.995351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 263/505] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:48.996182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.043383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd69db-dc2b-49b9-91b8-93de776ea99d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.082312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.083147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.083491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.083837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.084590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:49.084954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.086385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.100159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 243/506] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:49.100159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.106632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.111214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37f374-cfb9-4d2b-93e5-54a60bcf79de None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.115429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.151231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.151920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.152315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.152676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.208527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363d754-cff7-49da-ad75-bfcdaf3633c4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.225159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.226671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.242124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.242722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.242996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.243265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.243975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:49.244297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.245715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.281752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 244/507] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:49.282656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.321679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.327407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 264/508] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:49.328399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.356990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.387966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93a22-f837-4f09-a134-efdaaefd1438 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.423117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.423652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.423936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.424208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.424877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:49.425180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.426062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c1508-eaf6-45d8-bd80-23d3479abfe7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.426551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.437918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 245/509] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:49.438713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.461499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.462126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.462415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.462671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.473322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.474747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:49.488755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:49.489646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:49.490658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:49.490658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:49.490658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:49.490658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 265/510] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:49.491010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.538928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.546139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930273ec-4588-46a1-926a-f26eaff2a086 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.572787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.579555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.580282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.580561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.580831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.590284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486732d8-1c57-4d27-9e96-d5f7977396ee None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.590929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.592923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:49.606402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:49.607411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:49.608267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:49.608267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:49.608267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:49.608267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 246/511] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:49.608482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.635108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.635775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.636055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.636359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.708267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.709650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.713884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb44fe-0cfb-4fce-8e2c-c509a109b7c7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.747307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.748549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.748828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.749178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.755905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.759432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.760935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:49.775461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:49.776592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:49.777432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:49.777432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:49.777432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:49.777432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 247/512] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:49.777432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.808787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 266/513] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:49.809623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.811073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:49.876587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2187b-5d2b-4984-8f6a-b0194d6037c5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.909197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c967a5-67ce-4cbe-b4ce-c04cb44a62bb None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:49.909425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.910048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.910327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.910598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.917784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.919226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:49.930499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:49.931554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 248/514] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:49.932497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:49.966633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:49.967270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:49.967621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:49.967980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:49.968749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:49.969118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:49.972851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:49.986722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 267/515] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:49.987562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.004833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.037766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.045296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d1f9-81b9-43aa-9af1-8a4a56afd3f0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.078029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.078897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.079177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.079449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.080087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:50.080410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.081784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.090995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045d3f-bc84-4ea0-a317-691606ac3910 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.093935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 249/516] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:50.094552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.128992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.129593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.129874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.130145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.130783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:50.131084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.132480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.144182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 268/517] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:50.144998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.197189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d67a69-1194-469f-93d5-7b63fffcff5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.215723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.232417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.232986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.233263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.233534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.243126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.244581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.246299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b352e50-cc64-44f1-9491-88feb0dad326 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:50.258837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:50.259823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:50.260958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:50.260958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:50.260958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:50.260958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 250/518] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:50.260958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.270186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.287071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.288110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.288616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.289080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.290319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:50.290791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.292248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.315849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 269/519] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:50.316711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.371031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ea2cb-936a-47e0-b416-fa0a573d9340 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.405074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.406222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.406505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.406781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.414721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.416144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.417664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3843d5e-62bd-4e4d-ae29-3bd5d4b666ba None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:50.427641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:50.428715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 251/520] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:50.429681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.446599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.456081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.456720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.457001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.457269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.457896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.459330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.481020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 270/521] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:13:50 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:13:50.481851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.504217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.553549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e24ce-7042-49b8-8aa1-5830b9dade51 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.594846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.595498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.595782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.596056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.600092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c341e-aa8e-4ee3-88b6-85e028836bda None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.604093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.605630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:50.619004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:50.619959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:50.620884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:50.626441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 252/522] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:50.626583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.653861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.655130 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.655592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.656077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.657483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:50.657483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.658543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.680469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 271/523] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:50.682376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.738879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.765473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e90f58-7b3d-43d9-85ad-a4802e169386 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.797550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:50.799915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf27cf-c7eb-4883-b9e4-3ae9e290c998 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.808055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.808688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.809177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.809282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.835646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:50.836265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:50.836552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:50.836817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:50.837554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:50.837839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.839313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.861892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 272/524] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:50.861892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:50.892731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:50.894895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:50.968574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515eeb4-6af6-475e-87d1-94a3b2680215 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:50.970423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.015645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 253/525] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:51.015645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.017698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.018325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.018603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.018871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.019686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:51.019990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.021475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.039058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.047696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 273/526] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:51.048204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.117883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a37fa-0b72-483a-ab10-1cac57006b02 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.152866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08743-45ae-4b11-b421-68482854e579 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.153082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.153686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.154018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.154416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.161504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.162938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:51.173895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:51.174743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:51.175592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:51.179633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 254/527] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:51.180540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.192939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.193559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.193841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.194115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.226688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.270552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.270712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.272092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.287824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d71e6-5667-4552-9ebf-b5a6af71fc19 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.321911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.322542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.322816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.323090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.334097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.335540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:51.349222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:51.350212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:51.351054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:51.351054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:51.351054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:51.351054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 255/528] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:51.351054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.389148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 274/529] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:51.390284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.455442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.456436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99e27-cf58-4ea1-9695-00407f73882f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.490147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.490739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.491017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.491287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.492014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=880e3ed0ab1641a3bdab9ff349d09286) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:51.492348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.493779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.498472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a075b-a7b6-4d57-ba9c-9a068ab17c06 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.499659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 256/530] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/role_assignments?user.id=880e3ed0ab1641a3bdab9ff349d09286&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:51.500470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.503003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.560304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.562288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.563340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.563793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.564985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:51.565448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.567884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.582846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 275/531] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:51.583961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.627724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf24fb-4936-4525-911d-5edde7b1326d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.666270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.667079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.667454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.667870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.668560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:51.668864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.670884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.683286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 257/532] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:51.684131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.704421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5126e80-c66d-419b-a181-db987865a13b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.748959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.753540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.754187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.754467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.754739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.755807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:51.770670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.772521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:51.792404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:51.793469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:51.794546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:51.794546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:51.794546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:51.796121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77bc49-63db-4882-bad8-8d588c094dcd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:51.798309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 276/533] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:51.800072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.836744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:51.837572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:51.837851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:51.838123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:51.839003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=11289ffa17db4fe3b3c4b5ad034a4dab) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:51.839644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:51.841504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:51.852405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 258/534] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/role_assignments?user.id=11289ffa17db4fe3b3c4b5ad034a4dab&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:51.853421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:51.980271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249951-1cbd-462b-9da4-46733cf4cc17 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.047609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.048267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.048555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.048828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.056604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.057233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21da3-07d5-459a-afb5-e464cad1de48 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.058085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:52.073052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:52.073939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:52.074759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:52.079667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 277/535] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:52.080922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:52.098238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:52.105262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.107842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.109326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.109616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.110275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:52.110580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.111975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.141314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 259/536] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:52.145274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:52.149248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:52.231630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6827b-60e9-4d3a-8bd6-b531b859c703 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.280272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.280911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.281193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.281466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.282165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:52.282471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.283930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.299302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 278/537] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:52.312129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:52.385171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f47336-7368-4201-ac5b-70051befd5c3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.424551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:52.433790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb93274-25ba-4bb4-af6d-a4216823d689 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.473539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.474154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.474432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.474707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.475436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=f26c0d36d3054f098c05b3cdb93853b7) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:52.475740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.476941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.477193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.477590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.477870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.478140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.483853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 279/538] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:52 2022] GET /identity/v3/role_assignments?user.id=f26c0d36d3054f098c05b3cdb93853b7&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:52.497699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.499769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e0756266-7ede-4f95-9ada-4eedbd502a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:52.521936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:52.523042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:52.524092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:52.527816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 260/539] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:52.529296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:52.611995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091324d-ab11-4cb5-bb19-b31cee64f00e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.612655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091324d-ab11-4cb5-bb19-b31cee64f00e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.613123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091324d-ab11-4cb5-bb19-b31cee64f00e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.620372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 261/540] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:52.626508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.627100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.627567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.655463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:52.657112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:52.691573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e910-647a-4155-8cd2-5decdfcfb94e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.732330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.733280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.733567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.733843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.734541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:52.734851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.736310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.751379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 280/541] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:52.759171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:52.760997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:52.784844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:52.847249 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 262/542] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:52.882956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a06b6-8ea5-44bb-aebf-090476e26a09 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:52.925953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:52.926912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:52.927383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:52.927845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:52.928789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=fcd37115dc7f468cb67bcb79af5e89e3) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:52.929289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:52.930966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:52.940731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 281/543] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:52 2022] GET /identity/v3/role_assignments?user.id=fcd37115dc7f468cb67bcb79af5e89e3&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:53.237142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:53.346985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462087f-c50d-4452-9009-fd37d07f8be4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:53.385860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:53.386582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:53.386946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:53.387231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:53.400118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:53.405823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:53.406672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:53.407843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 263/544] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:53.413156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:53.498558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:53.519200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4de98-4f79-49ae-9a88-f38d1e3bfdfc None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:53.554591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:53.555205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:53.555488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:53.555765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:53.556455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:53.556763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:53.558132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717cd6d-3c56-4849-9b54-d07278cb2746 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:53.567007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 282/545] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:53.572602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:53.629402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:53.633284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f591ae-d87f-4783-9be7-759114f0a1f1 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:53.633571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f591ae-d87f-4783-9be7-759114f0a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:53.633851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f591ae-d87f-4783-9be7-759114f0a1f1 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:53.635442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 283/546] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:53.640587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:53.640875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:53.641152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:53.677253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:53.678471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:53.706974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32559f-24f2-4f52-9b41-33060928f3b8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:53.754588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:53.755143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:53.756664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:53.756943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:53.777474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:53.779018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:53.802986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:53.803916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:53.805348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:53.805348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:53.805348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:53.805348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 264/547] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:53.810643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:53.818933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 284/548] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:53.923240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:53.943495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903b29-3095-4c6b-97ff-2f3cd67e2e9e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:53.992774 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:53.993386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:53.993664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:53.993935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:53.994581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:53.994884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:53.996233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:54.012980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 265/549] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:54.018798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:54.136594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:54.166974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f657ff-cc67-4f2a-baf4-a7f8ce9ef176 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:54.219452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:54.220198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.220568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.220882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.228930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:54.230654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:54.249531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:54.250013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:54.251626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:54.252945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 285/550] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:54.258356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:54.390615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19836a-36af-401c-af9a-a30db764a2c5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:54.431246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e6f61-7391-4e2f-b92b-754b8053a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:54.431934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e6f61-7391-4e2f-b92b-754b8053a52d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.432219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e6f61-7391-4e2f-b92b-754b8053a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.432515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e6f61-7391-4e2f-b92b-754b8053a52d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.444664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e6f61-7391-4e2f-b92b-754b8053a52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0e5e6f61-7391-4e2f-b92b-754b8053a52d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:54.450416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:54.451381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:54.452623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 266/551] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:54.453907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36642621-46c9-483d-9e85-c8de1cf76c01 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.453907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36642621-46c9-483d-9e85-c8de1cf76c01 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.453907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36642621-46c9-483d-9e85-c8de1cf76c01 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.455409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 267/552] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:54.459962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36642621-46c9-483d-9e85-c8de1cf76c01 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:54.467059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200c68b-b5ee-49cc-b031-0f6341494fc4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:54.488680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:54.506872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:54.507534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.507817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.508085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.508873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:54.509706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:54.511163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964ddc-d4c2-4247-a347-9e135f744591 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:54.514372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:54.537412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 286/553] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:13:54.539358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.539648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.539924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.561812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:54.563506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:54.587509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36642621-46c9-483d-9e85-c8de1cf76c01 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:54.633511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:54.634915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.635549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.636148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.637202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:54.637712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:54.640340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:54.656351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 287/554] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:54.656351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:54.663994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 268/555] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:54.669121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:54.782893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:54.808484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35d2cc-47b3-41c7-bb5d-4b648f8fef9c None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:54.837604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:54.847355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b0da-f80b-4fdb-a014-480f362d1785 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:54.848697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fcf09-77d1-4922-8934-cba8c17b4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:54.849581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcf09-77d1-4922-8934-cba8c17b4934 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.850097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcf09-77d1-4922-8934-cba8c17b4934 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.850605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcf09-77d1-4922-8934-cba8c17b4934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.897996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:54.898749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.899030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.899369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.915305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:54.917398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:54.931512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fcf09-77d1-4922-8934-cba8c17b4934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:54.933454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fcf09-77d1-4922-8934-cba8c17b4934 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-102fafbd-c5df-4991-95d0-68991aab5342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:54.936467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:54.937387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:54.938236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:54.938236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:54.938236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:54.940388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 269/556] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:13:54.941907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139f85-1723-4a9a-ae9c-7de397157c43 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:54.942407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139f85-1723-4a9a-ae9c-7de397157c43 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:54.942965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139f85-1723-4a9a-ae9c-7de397157c43 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:54.944872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 270/557] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:54.949635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139f85-1723-4a9a-ae9c-7de397157c43 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.066030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 288/558] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:13:55.067297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.067582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.067850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.071925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139f85-1723-4a9a-ae9c-7de397157c43 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.086940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:55.088119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:55.097989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.106303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.111069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.111676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.111971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.112263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.112908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:55.113212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.114570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.132340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 271/559] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:55.132340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.176359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 289/560] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:55.176359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.248239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4db2-6b65-4a41-b4c1-2c70a0890180 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.291658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca624a9-5d2a-420f-983c-8e80857c9eae None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.298134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.298850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.299199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.299538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.317581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:55.324644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:55.325536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:55.326748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 272/561] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:55.327539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.344377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.345297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.346135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.346561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.361786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.364465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.379859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:55.388074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:55.389378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:55.390459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:55.390459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:55.390459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:55.392575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 290/562] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:55.393592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.400522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.449480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6748640-2847-4dfc-abaa-dfbbca99e30f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.487321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.488045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.488401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.488696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.496372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.498570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.507787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0bc13-dacc-43ac-a981-09b8cbae13f5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:55.510432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:55.511365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 273/563] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:55.512793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.541483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.542088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.542366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.542636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.543297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:55.543601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.545596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59f052-6373-4fb3-8408-e1b7759d5f00 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.553606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 291/564] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:55.554775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf3d8-5aa4-4a30-b41e-0420fe770958 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.555061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf3d8-5aa4-4a30-b41e-0420fe770958 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.555335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdf3d8-5aa4-4a30-b41e-0420fe770958 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.556565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 292/565] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:55.557242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdf3d8-5aa4-4a30-b41e-0420fe770958 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.621434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924b4d8-1495-46ef-896c-af8015c71b82 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.622093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.623346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.657128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.657733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.658010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.658283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.658494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdf3d8-5aa4-4a30-b41e-0420fe770958 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.658915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:55.659214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.660599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.672098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 274/566] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:55.673017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.697428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.698117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.698425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.698737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.710157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:55.714985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:55.715860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:55.717551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 293/567] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:55.718231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.772738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04a462-4853-4085-adaa-1401c57a8c71 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.807522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.808117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.808427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.808697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.809423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:55.809723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.811368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cc7e5-f186-4dbc-9060-e3ea26c87c7a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.817447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4e158-c81c-4846-9647-b7d5ec8104ae None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:55.828522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 275/568] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:55.829973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.830259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.830531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.847800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.847969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:55.849331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:55.859029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:55.859662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:55.859940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:55.860209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:55.863990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:55.870476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:55.871909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:55.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:55.887612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:55.888810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:55.888810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:55.888810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:55.888810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 294/569] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:55.888810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.918942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 276/570] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:55.920687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:55.991869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36b97-07e5-4b56-8efc-4b86cefdca76 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.029882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.030518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.030795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.031070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.033043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed7ba-d702-4ad6-9aeb-5a05fac99020 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.037760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.039185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:56.051148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:56.052155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 295/571] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:56.053182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.072468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.073140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.073420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.073693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.074353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.074659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.076703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.085010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 277/572] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.085795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.102960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.106098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.173720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a25f4-12b8-4ba1-9ffa-a9e6c0a45ac5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.196866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a09f9d-2e1f-40e9-9a48-cb9d3c8ee5d4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.209659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.210292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.210573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.210846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.221288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.222740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.234390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.235017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.235318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.235632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.236319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.236625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:56.237842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:56.238879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:56.239856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:56.239856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:56.239856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:56.240024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.240091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 296/573] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:56.240196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.259582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 278/574] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.259582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.329276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.330672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.339624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602efc-4018-4b2d-971e-ad7fec0e0c5f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.362712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97aa78-04e8-4d1f-80d2-2caa55cce659 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.374564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.375169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.375449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.375719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.376438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.376744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.378166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.390177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 297/575] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.390969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.398640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.399272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.399554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.399827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.410990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.412455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:56.427915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:56.429162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:56.430062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:56.430062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:56.430062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:56.430062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 279/576] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:56.430282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.496018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976e8a-f6cb-41e9-9ac5-c6555a00575c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.529805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.530456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5e098-4f3d-47e1-bee1-7f39838443fd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.530552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.530702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.530974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.541117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:56.546482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:56.547668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 298/577] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:56.548639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.556588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.562007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.568263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.568947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.569262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.569551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.570239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.570579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.572051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.584378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 280/578] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.585233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.656163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02269dbb-9d96-4b8c-bd54-477afc103306 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.686928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761b66-fdad-463d-b3c7-545bad996edf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.689193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.689820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.690098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.690367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.697148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.698576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:56.710191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:56.711190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 299/579] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:56.712187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.725406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.726062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.726364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.726664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.727468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=a9e4244f9ac349feb38fce19062e7c4b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.727775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.729331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.745650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 281/580] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/role_assignments?user.id=a9e4244f9ac349feb38fce19062e7c4b&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.745650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.796080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.799410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:56.833122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6628ea-f740-44c5-b25d-5a6077004d5b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.869011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25dea4-4893-4408-ac69-5bd9c4160f54 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:56.874363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.874978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.875253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.875521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.876168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.876491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.877865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.892270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 300/581] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.893627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:56.906452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:56.907063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:56.907342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:56.907811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:56.908339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:56.908639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:56.909999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:56.923169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 282/582] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:56.923169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.017569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90486a73-7dd1-4f0b-bbb5-e331fca61a2f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.037866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0524cfd-5eba-4598-afdb-46d7cce44133 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.047596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.050267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.053711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.054346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.054622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.054891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.061857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.063289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:57.074798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:57.076556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 301/583] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:57.078101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.084650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.085259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.085533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.085803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.086526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:57.086826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.088238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.113272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 283/584] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 17 19:13:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:57.113272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.187421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684f21-c399-4ce9-801e-82e552c040ab None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.222222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.222856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.223134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.223408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.226164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31de2-bdae-4c07-99a7-69edeea4587a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.231017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.232809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:57.243784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:57.244955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:57.245862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 302/585] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:57.246420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.265457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.266314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.266755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.267167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.277862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.280082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:57.295150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:57.296268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:57.297358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:57.297358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:57.297358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:57.298852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 284/586] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:57.299250 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.300477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.325559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.355056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc37c0-1e33-4091-9054-d49eb3062b13 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.390194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.390811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.391091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.391360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.392052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:57.392384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.393806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.406776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 303/587] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:57.407576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.414725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a83da-15b8-475c-8a1b-9500e19f5f27 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.454770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.455421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.455704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.456138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.469800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.471391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:57.486736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:57.487693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:57.488609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:57.488609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:57.488609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:57.488609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 285/588] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:57.488609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.515772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9401a-d8be-4ff4-8805-9558408d33d4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.527144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.552747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.553458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.553800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.554132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.555002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:57.555368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.556989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.565336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.581245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 304/589] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:57.581245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.602838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10173652-f344-4395-97ae-3d728320e0e2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.636188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.636823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.637106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.637382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.638015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:57.638841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.640492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.652920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 286/590] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:57.653560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.689323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde044-c4c5-421a-b48d-04a310d1a3a2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.728114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.728808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.729090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.729363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/880e3ed0ab1641a3bdab9ff349d09286/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.744331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=880e3ed0ab1641a3bdab9ff349d09286, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.745783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.768286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 305/591] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:57 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/880e3ed0ab1641a3bdab9ff349d09286/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:57.768286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.775075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fc8e-e0f1-4125-a08b-860c00ff55bb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.783293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.817142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:57.824216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.825355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.826147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.826510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.827173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:57.827470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.829811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.850740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 287/592] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:57.851727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:57.905360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d5076-e0f3-4d2a-aef1-c56ff66c9333 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.947987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:57.949078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:57.949369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:57.949931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:57.963823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:57.965512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:57.980686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b571d-ed35-45f2-b700-d2b1bd9e6c43 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:57.982929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:57.983840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:57.984772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:57.984772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:57.984772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:57.984772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 306/593] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:57.985551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.039282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.040642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.041069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.041790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.051801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.054141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:13:58.070757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:58.071855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:13:58.072797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:58.075300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 288/594] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:58.077202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.078134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.118079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a024ff-8350-42e8-afd4-4feabf7856b2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.148483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.158315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.159293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.159714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.160217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.167378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.169224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:58.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:58.182143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:58.182996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:58.190384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 307/595] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:58.191540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.203240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351e935-c7a5-4a2e-91fc-08bdc8bdd024 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.241406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.242568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.242727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.243292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.244090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:58.244449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.245992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.259786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 289/596] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:58.262289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.301008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9cb9-03d4-487e-b725-11e96da358be None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.336996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.338071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.338546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.339012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.339955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:58.340477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.342328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.362011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 308/597] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:58.362372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.372326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.373174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b664-e5b1-4dfb-b0b7-fc225c6e7c5c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.385825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.410173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.410789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.411066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.411336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.412055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:58.412453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.413990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.433569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 290/598] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:58.434429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.512836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd7a18-d112-4352-a9a1-d1738dbc425c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.564303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.565075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.565472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.565748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.566364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38330-45a1-4a8d-a4dc-71caecba9dbd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.574451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.576600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:58.592429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:58.593298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:58.594158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:13:58.595165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 309/599] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:58.595165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.606507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.607662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.607939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.608207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.620453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.621889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:13:58.636904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:58.639086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:13:58.641166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:13:58.641166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:13:58.641166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:58.641166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 291/600] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:58.641166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.661586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.670649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.727712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da14e76-a186-4be5-b4f3-2a40c081b11b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.764659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.765072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de596-ab82-4c1a-ab45-5ded51d6f078 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.765375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.765687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.765957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/11289ffa17db4fe3b3c4b5ad034a4dab/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.781775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=11289ffa17db4fe3b3c4b5ad034a4dab, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.783239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.796450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 310/601] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:58 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/11289ffa17db4fe3b3c4b5ad034a4dab/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:58.797269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.812671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.813662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.814268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.814778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.815906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:58.816436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.818386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232fbe-b434-4467-99eb-4411dbe97691 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.839165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 292/602] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:58.842211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fbac-92a4-4dd4-ae1e-aee703f2286d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.842822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fbac-92a4-4dd4-ae1e-aee703f2286d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.843293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fbac-92a4-4dd4-ae1e-aee703f2286d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.845654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 293/603] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:58.846779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fbac-92a4-4dd4-ae1e-aee703f2286d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:58.923724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.928605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38572423-6592-4046-9f4b-91961ffab2f9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.961511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:58.980610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:58.981236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:58.981511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:58.981801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:58.982486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:58.982823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:58.984154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d5635-969f-4e59-8dae-7b0df544dca3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:58.993309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fbac-92a4-4dd4-ae1e-aee703f2286d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:58.998611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 311/604] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:59.003166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.003166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.003166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.025736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:13:59.027083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:13:59.035560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:59.036479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.036957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.037376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/f26c0d36d3054f098c05b3cdb93853b7/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.053792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=f26c0d36d3054f098c05b3cdb93853b7, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:59.055534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:59.073868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 294/605] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:58 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/f26c0d36d3054f098c05b3cdb93853b7/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:13:59.075857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:59.143921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 312/606] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:13:59.227178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4889c22-9e76-4a96-804c-43e1814ab482 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:59.272727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:59.273725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.274170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.274659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.276831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:59.287489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:59.289440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:13:59.302784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:59.303867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:13:59.304954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:59.305867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 295/607] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:59.311423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:59.410451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:59.422964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31897ade-91e3-4503-9281-ad5649ef3c50 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:59.474297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:59.474916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.475191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.475457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.476149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:13:59.476477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:59.477964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:59.487750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:59.493103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 313/608] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:13:59.499582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:59.635749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74ca3-26ce-47d1-b1ee-608d7340daa3 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:59.692115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171aac12-d085-420d-956b-ab521d23d685 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:59.693473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:59.694388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.694867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.695334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/fcd37115dc7f468cb67bcb79af5e89e3/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.717435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=fcd37115dc7f468cb67bcb79af5e89e3, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:13:59.719280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:13:59.733678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:13:59.748273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 314/609] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:13:59 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/fcd37115dc7f468cb67bcb79af5e89e3/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:13:59.750056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0d61-d0bc-444b-b0ef-e1cc4caab7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:13:59.750936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0d61-d0bc-444b-b0ef-e1cc4caab7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.751402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0d61-d0bc-444b-b0ef-e1cc4caab7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.751878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0d61-d0bc-444b-b0ef-e1cc4caab7f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.768183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff0d61-d0bc-444b-b0ef-e1cc4caab7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8eff0d61-d0bc-444b-b0ef-e1cc4caab7f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:13:59.774019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:13:59.775286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:13:59.776376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:13:59.784427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 296/610] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:13:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:13:59.789436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:13:59.952773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21416b5d-ad4a-4c8d-9beb-93683e96ae8a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:13:59.964412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe97a-db14-40f4-bd73-be698513b1b5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.964969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe97a-db14-40f4-bd73-be698513b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.965409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fe97a-db14-40f4-bd73-be698513b1b5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:13:59.971047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 297/611] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:13:59.977226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c920-d843-4347-8274-078f609c840a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:13:59.980436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c920-d843-4347-8274-078f609c840a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:13:59.980921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c920-d843-4347-8274-078f609c840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.002697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:00.003390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:00.003732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:00.004019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.004730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:00.005083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:00.006732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:00.007286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6748c920-d843-4347-8274-078f609c840a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:00.008849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6748c920-d843-4347-8274-078f609c840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:00.019748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 315/612] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:13:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:00.026473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.098238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:00.098446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:00.143239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 298/613] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:14:00.151412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d176-3508-4a08-b756-d77ccbbd5b06 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:00.187673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:00.188612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:00.189030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:00.189435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.201728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:00.203532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:00.219590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:00.220821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:00.221897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:00.221897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:00.221897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:00.223653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 316/614] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:00.229212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748c920-d843-4347-8274-078f609c840a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.362030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748c920-d843-4347-8274-078f609c840a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:00.410882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:00.411738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:00.412160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:00.412594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.413497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:00.413935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:00.415435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:00.428090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 299/615] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:00.433209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.596257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222134b-f380-4bed-8ace-00bcf3acd2a9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:00.614326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:00.625702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.647329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:00.648599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:00.649064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:00.649491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.664321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:00.666097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:00.680550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:00.681549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:00.682470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:00.685740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 317/616] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:00.694897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.696848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:00.814238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9a1b7-1742-4ee6-b0ba-585349c30b25 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:00.847041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcec1a-3b60-4913-a854-c8594d629849 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:00.854473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:00.855350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:00.855762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:00.856148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.857722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:00.858131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:00.859665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:00.879489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 318/617] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:00.886680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.886887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:00.887671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:00.887951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:00.888271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:00.898999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:00.904909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:00.905997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:00.907009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 300/618] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:00.913450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:00.955811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.056917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8a77-08e3-4775-9437-89750880e884 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.070371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd16755-3014-42a8-984d-04ba3a9d6aea None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.082402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.093601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.094467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.094842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.095264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.096027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:01.096460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.098188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.108999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 301/619] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:01.114320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.114987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.115267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.115537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.119097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.127885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.129578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:01.151637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:01.152967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:01.153975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:01.153975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:01.153975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:01.156360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 319/620] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:01.161537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.257665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.278339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e9273-bb5c-4acc-b0b2-3697117f5eed None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.301415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36318ff2-f35f-4e28-aad0-309779cdfdb3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.328223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.329252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.329848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.330181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.331299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:01.331861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.333548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effac3b6-4de9-469f-851c-8fe6aae9181a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.343087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.343889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.344338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.344729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.352438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 320/621] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:01.353922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab041-bb32-404d-8ed1-b8f0cab46b49 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.354337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab041-bb32-404d-8ed1-b8f0cab46b49 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.354739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab041-bb32-404d-8ed1-b8f0cab46b49 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.359004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.359596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 321/622] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:01.360378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab041-bb32-404d-8ed1-b8f0cab46b49 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.360845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-69ced051-135f-456b-ba8b-102d51d9c4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:01.380038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:01.381175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:01.382201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:01.382201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:01.382201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:01.384310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 302/623] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:01.390680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.391095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.391507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.411859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:01.413392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:01.428621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.495422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab041-bb32-404d-8ed1-b8f0cab46b49 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.497867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 303/624] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:01.501136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.578336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.579456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.579869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.580296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.594678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.596601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:01.623804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:01.624903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:01.625847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:01.628662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 322/625] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:01.635789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.641793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.710965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ec40-8ae3-4fde-99ac-2f5a890bd159 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.758931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.759645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.759930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.760206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.760989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:01.761303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.762663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f1e3b-49d0-436c-bf1a-04150c8af82e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.775563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 304/626] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:01.776822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35f48d-06e2-4f70-91c0-ab7cb4298a96 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.777127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35f48d-06e2-4f70-91c0-ab7cb4298a96 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.777380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35f48d-06e2-4f70-91c0-ab7cb4298a96 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.782893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 305/627] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:01.783810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35f48d-06e2-4f70-91c0-ab7cb4298a96 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.795746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.803959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09be08f-34e6-4dcf-bd22-cbd613ba909b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.843209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.843829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.844109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.844413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.845144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:01.845451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.846911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976300e-91e4-4d6e-b0ac-ac17fede1e0f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:01.860468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 323/628] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:01.860687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.860802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.861141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.880100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:01.881244 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:01.934658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35f48d-06e2-4f70-91c0-ab7cb4298a96 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:01.942469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:01.955166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 324/629] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:01.957166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:01.973688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:01.974193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:01.974463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:01.974743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:01.989079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:01.990412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:02.008291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:02.009229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:02.010259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:02.016494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 306/630] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:02.016494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.071900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df823-8b07-42e4-b814-1a9c0610b4d4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.086838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.108800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6634b2-c9cc-4fdf-abf0-a6c8e11a9fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.109454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6634b2-c9cc-4fdf-abf0-a6c8e11a9fba None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.109730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6634b2-c9cc-4fdf-abf0-a6c8e11a9fba None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.109997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6634b2-c9cc-4fdf-abf0-a6c8e11a9fba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.120603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6634b2-c9cc-4fdf-abf0-a6c8e11a9fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:02.122877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf02c8b-3515-41af-9939-c2d1de7d90c7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-0d6634b2-c9cc-4fdf-abf0-a6c8e11a9fba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:02.125536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:02.126463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:02.127284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:02.128619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 325/631] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:02.130079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955adf02-62a7-42ad-95f3-e07263bd9580 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.130536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955adf02-62a7-42ad-95f3-e07263bd9580 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.130864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955adf02-62a7-42ad-95f3-e07263bd9580 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.132394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 326/632] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:02.133825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955adf02-62a7-42ad-95f3-e07263bd9580 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.165067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.165953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.166371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.166811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/a9e4244f9ac349feb38fce19062e7c4b/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.182452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=a9e4244f9ac349feb38fce19062e7c4b, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:02.184549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.198727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.208271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 307/633] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:02 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/a9e4244f9ac349feb38fce19062e7c4b/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:14:02.208271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.265107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955adf02-62a7-42ad-95f3-e07263bd9580 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.307839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.308512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.308796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.309065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.309836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:02.310145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:02.311604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74f72-f9ef-4544-a931-ea350acdafde None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.331416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 327/634] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:02.332741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.333027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.333298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.333711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a56f78-5450-488c-9d89-356b7ba792d2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.354701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:02.357369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:02.360566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.382467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.383093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.383440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.383789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.384539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:02.384845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:02.386332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.399800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 308/635] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:02.399800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.448285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 328/636] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:02.448285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.492000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.520499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36b605-b893-406b-8b9b-7ef08ace5336 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.557498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7d65-a210-41c8-80d2-2c801521f0e9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.566854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.567552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.567859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.568172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.583991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:02.592476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:02.593557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 309/637] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:02.594394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.597619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.598340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.598712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.599075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.658505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.682011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:02.683490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.723659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed1c5e-0b5e-48af-97ca-75da95f6b838 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.746848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.760543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.761180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.761457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.761731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.773493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:02.774651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:02.789493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:02.790455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:02.791322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:02.791322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:02.791322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:02.791322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 310/638] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:02.792028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.818168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 329/639] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:02.819810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.897495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.907325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166157-e47c-4e4b-8635-1a87cb746831 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.926319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfeba-d2ed-4566-88fa-4d41fdf2c41a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:02.942031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.942630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.942904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.943172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.943824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:02.944120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:02.945507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:02.953498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 311/640] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:02.954376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:02.970050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:02.970956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:02.971417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:02.971885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:02.985109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:02.988506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:02.993784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:02.994703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 330/641] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:03.001924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.063653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0220760-aeb7-40d0-a74a-241a6be65c08 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.097330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.097934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.098211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.098479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.099109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:03.099405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.100799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.112998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 312/642] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:03.113787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.114366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ac6b5-ff67-496c-9ba3-34a1efe61ff3 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.130051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.157772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.158408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.158686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.158957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.170666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.172780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:03.189144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.190170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:03.191053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:03.191053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:03.191053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:03.191053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 331/643] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:03.191053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.228827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95459f-c2d6-4097-bc21-20c9723c30aa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.246219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.266354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.266985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.267262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.267530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.278000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.280252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.294903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c76f34-826e-4167-9661-cd32db9e031f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:03.295621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.296831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:03.297884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:03.297884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:03.297884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:03.297884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 313/644] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:03.297884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.340029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.348839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.349288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.349879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.351331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:03.351878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.353349 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.366618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 332/645] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:03.366618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.379910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.418494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467fd64-ae9b-45ce-a909-9313a2182be3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.452584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.453137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.453417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.453952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.461360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.462785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:03.473712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.474692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 314/646] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:03.475754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.483754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ee59-3c4a-4588-83ca-0d5d2a456384 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.499283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.521184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.521784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.522056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.522326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.522958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:03.523451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.524725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.537516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 333/647] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:03.538238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.587569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd60e-5f4f-4657-8286-3ae9d497a596 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.613445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.623064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.623670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.623948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.624222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.624885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:03.625185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.626537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.638400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 315/648] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:03.639270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.660517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdb746-38f9-4ed1-9705-63c1bc531edc None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.696143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.696833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.697079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.697344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.708330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.709713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:03.724562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.725563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:03.726461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:03.726461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:03.726461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:03.726461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 334/649] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:03.726461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.745539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cb0f-4ec4-4110-8061-633f96d0d04b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.755236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.782381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.782986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.783261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.783531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.784734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:03.785041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.786448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.804366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 316/650] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:03.805186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.838703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9557-70bb-4635-8434-625d44320c3a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.862067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:03.885215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.886169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.886169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.886443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.893686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.895372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:03.908115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.909128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:03.910039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 335/651] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:03.910535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:03.927991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8917fc-ffda-4ed1-8695-476d4d56425f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:03.966587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:03.967199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:03.967476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:03.967781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:03.975458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:03.976915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:03.993990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:03.994975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:14:03.996090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:03.999794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 317/652] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:04.000670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.011311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.027805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757060b-3c33-4b95-bf65-a80e8d331b56 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.064330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.064933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.065213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.065481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.066117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:04.066415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.067881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.080907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 336/653] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:04.085813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.105367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10af907-5978-43d0-9adc-f3f149f7d00c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.108826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.146210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.146828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.147133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.147382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.193274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015a7fa-bb62-4212-8bbc-74f48b7a15dc None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.231819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.232636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.232636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.232900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.233655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:04.233958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.235397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.236605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.238044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.248235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 337/654] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:04.249105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.259129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.348953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 318/655] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:04.349801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.353848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.356375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336936b-7062-4af4-a171-6406ca605265 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.391490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.392098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.392409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.392685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.393416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:04.393723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.395162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6424f-bfca-486f-96c7-0d7114bef1a9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.412600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 338/656] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:04.413980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf70ca-53b6-4ca9-af20-3dfd924e68d4 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.414260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf70ca-53b6-4ca9-af20-3dfd924e68d4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.414530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf70ca-53b6-4ca9-af20-3dfd924e68d4 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.415752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 339/657] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:04.420299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf70ca-53b6-4ca9-af20-3dfd924e68d4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.455080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d476e05-79e1-4e79-be42-e22268f868a0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.480065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.488832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.489400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.489678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.489995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.496805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.498969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:04.510307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:04.511418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:14:04.512585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:04.516321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 319/658] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:04.517012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.521323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf70ca-53b6-4ca9-af20-3dfd924e68d4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.555842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.556539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.556823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.557096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.557816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=880e3ed0ab1641a3bdab9ff349d09286) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:04.558121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.559558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.566357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 340/659] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/role_assignments?user.id=880e3ed0ab1641a3bdab9ff349d09286&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:04.567159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.581201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.625724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397f14-80a2-4e88-8410-f7b80fd215f0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.667018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.667674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.667956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.668304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.679953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.681474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.690442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69423c8-5164-49bb-824c-a41140543e61 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a7eeb693-e8db-4d2e-ac82-f9be1f301d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:04.703063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:04.704672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:04.705554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:04.705554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:04.705554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:04.706255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 320/660] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:04.707778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.708064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.708372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.729828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:04.730019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.731050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:04.738615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.739796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.739796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.739796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.813297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 321/661] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:04.813951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.817482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.819036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:04.876411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.936665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 341/662] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:04.937662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:04.947827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054f8e-c375-47cd-b865-ffa13a1db4a3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:04.977020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:04.992831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:04.993510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:04.994142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:04.994142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:04.995083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:04.995519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:04.997091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.019178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 322/663] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:05.020438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.076650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c770ecd-dc08-409b-9a28-115506513b1e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.116519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.117242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.117421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.117666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.118303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:05.118601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.119961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.130928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af802f4-13f7-45e9-a873-0b7885cb5629 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.134117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.136067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 342/664] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:05.137104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.170804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.171429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.171708 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.171977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.182203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.183646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:05.198984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:05.200130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:05.201986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:05.201986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:05.201986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:05.206107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 323/665] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:05.206824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.237801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.251817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f883c-cc13-4f89-b392-965837e17e92 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.287523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.288299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.288692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.289062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.314319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a0244-36ff-456f-9660-dd24fee2c2c8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.351733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.352379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.352659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.352930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.361019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.362564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.363287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:05.368604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:05.369718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 324/666] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:05.370811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.391461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.462640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.481760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 343/667] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:05.481996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af3dd-2fb5-4228-9ef3-8834b728558c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.482152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.517767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.518311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.518583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.518855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.525551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.526968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:05.538055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:05.539104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:05.540186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:05.543863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 325/668] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:05.544807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.587408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffc69-5be6-404e-954a-15f8b3a0af01 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.628510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.629127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.629598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.629869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.630515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:05.630814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.631161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.633263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.652394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 344/669] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:05.653379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.660718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379feee-e9f1-4da2-926b-4a2535d24b91 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.696307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.696900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.697175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.697444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.698103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:05.698421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.699757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.712294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 326/670] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:05.712294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.720497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.778089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ffb92-d480-414b-87e3-75be62551243 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.812920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e107cb-99d6-421d-9837-cb9e5018b520 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.813646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.814289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.814567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.814841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.826867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.828881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:05.845086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:05.846037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:05.846931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:05.846931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:05.846931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:05.846931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 345/671] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:05.847157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.858094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:05.858711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:05.859048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:05.859254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:05.859945 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:05.860266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:05.861800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:05.872367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.882981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 327/672] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:05.884010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:05.957987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:05.961505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883093-97ca-48ff-b2b4-68ade9aa9d45 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:05.998343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0ea00-3172-4997-9623-cff10765f951 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.008377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.009402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.009696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.009973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.020889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.022348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:06.035502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:06.036579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 346/673] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:06.037887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.046232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.047202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.047309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.047593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.059400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.061706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:06.078994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:06.079966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:06.080867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:06.080867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:06.080867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:06.080867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 328/674] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:06.081112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.132127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:06.152031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3b410-c4ac-4034-a510-22ceca78387c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.188544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.189528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.190020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.190483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.191312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:06.191803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf6b37-c96a-4294-b73a-2b87b3d27b47 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.192007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.193589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.207272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 347/675] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:06.208512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.233267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:06.233584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.234396 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.234798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.235288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.236159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=11289ffa17db4fe3b3c4b5ad034a4dab) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:06.236494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.238442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.246032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 329/676] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/role_assignments?user.id=11289ffa17db4fe3b3c4b5ad034a4dab&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:06.246839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.353218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef664f2d-677e-477d-8440-6ff47a768725 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.390498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aaa0c-dca0-486e-9646-6b0c13695465 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.409271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:06.414040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.414301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.414551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.414810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.416278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:06.416278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.418401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.431557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 348/677] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:06.435751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.436436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.437071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.437178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.437361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.438868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:06.439171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.440581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.454269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 330/678] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:06.455115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.541610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:06.572107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07b03d-dcc6-415c-a3ce-05ea228339aa None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.582991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebdd64-03c3-4645-8274-2e700c0c0689 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.618311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.618865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.619146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.619420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.622835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.623521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.623802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.624075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.624841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=f26c0d36d3054f098c05b3cdb93853b7) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:06.625153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.626878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.627005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.628350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.634217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 331/679] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/role_assignments?user.id=f26c0d36d3054f098c05b3cdb93853b7&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:06.635266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:06.645500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:06.646435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:06.647305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:06.656754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 349/680] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:06.662584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.695745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:06.790561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461794d-16ff-4fc8-8d8b-5be15b0e459e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.792534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912f90b-7a33-444e-8fbc-fbf67f5023e4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:06.830752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.831342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:06.831567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.831758 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.831931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.832096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.832313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.832513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.832684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:06.836269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.836269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b01c6-59bc-437c-b1aa-4297b0190815 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.840608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:06.842668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:06.847100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:06.853300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 350/681] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:06.854655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9218efb-331c-4d0e-b591-9673ae8348a4 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.855094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9218efb-331c-4d0e-b591-9673ae8348a4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.855546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9218efb-331c-4d0e-b591-9673ae8348a4 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-774c72a8-dfca-4e0d-84ce-3b37979bf42f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:06.858685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:06.860524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:06.861669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:06.862214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 351/682] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:06.862286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 332/683] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:06.865830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9218efb-331c-4d0e-b591-9673ae8348a4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:06.866497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:06.866786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:06.867755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:06.888858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:06.889977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:06.981602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 333/684] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:14:06.982976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:07.001911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9218efb-331c-4d0e-b591-9673ae8348a4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:07.023786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:07.074285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:07.076952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:07.078975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:07.080155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:07.081211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=fcd37115dc7f468cb67bcb79af5e89e3) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:07.083130 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:07.086066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:07.099453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 352/685] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/role_assignments?user.id=fcd37115dc7f468cb67bcb79af5e89e3&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:07.167370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590bcdd-4bf2-4ac3-ab7d-4d768b461167 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:07.222134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:07.222816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:07.223101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:07.223374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:07.224121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:07.224458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:07.225894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:07.252823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 334/686] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 17 19:14:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:07.257961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:07.336883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:07.377835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651c7db-9168-4032-8545-80651fa01246 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:07.418142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:07.418722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:07.419002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:07.419793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:07.439244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:07.523726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:07.525864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:07.594193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:07.597882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:07.634984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0078-7d3c-4e24-8a87-db6af9803182 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:07.639206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 353/687] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:07.645580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:07.751300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3be67-4333-4b8d-be9d-b0f4ef614655 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:07.761281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50723863-e996-47a3-b269-472f5976096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:07.761932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50723863-e996-47a3-b269-472f5976096b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:07.762216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50723863-e996-47a3-b269-472f5976096b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:07.762490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50723863-e996-47a3-b269-472f5976096b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:07.787688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:07.788744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:07.789233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50723863-e996-47a3-b269-472f5976096b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:07.789442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:07.789903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-50723863-e996-47a3-b269-472f5976096b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:07.794058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:07.795492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:07.796386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 335/688] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:07.804322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:07.806125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:07.813293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50723863-e996-47a3-b269-472f5976096b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:07.821753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:07.822697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:07.823564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:07.823564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:07.823564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:07.825782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 354/689] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:07.831623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:07.868274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:07.968621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038738-8d25-4dbd-9c5a-cba92706dd0c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.019755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.020499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.020688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.021177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.022297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:08.022611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.024008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.033811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50723863-e996-47a3-b269-472f5976096b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.057380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 355/690] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:08.062924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.109135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.109753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.110033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.110308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.110976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:08.111324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.112991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.140417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 336/691] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:08.145972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.161981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:08.214796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:08.258115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00f4ce-e1e3-4e28-8b50-a2fdac0ef326 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.308369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd00b-f3fa-46ac-8b33-26db0221f1fa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.338088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.338722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.339003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.339276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.340485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.342386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.342595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.348611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.350733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.352181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.364177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.365663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:08.375453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:08.376503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:08.377403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:08.377403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:08.377403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:08.380383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 337/692] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:08.384731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:08.387145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:08.390686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:08.392871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:08.400423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 356/693] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:08.408674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.479215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:08.525648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf462db-2aea-46f1-9257-2f39469ca9b2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.561404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c3105-4ebd-4874-a160-0d10a7a509cf None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.571161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.572141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.572471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.572754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.573973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:08.574294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.576116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a0c9-cd6a-407d-a341-c167ad74f657 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.596270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 338/694] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:08.596270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421696-f012-46f0-ac3c-cb74b06c8013 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.596270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421696-f012-46f0-ac3c-cb74b06c8013 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.596270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421696-f012-46f0-ac3c-cb74b06c8013 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.596270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 339/695] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:08.598803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421696-f012-46f0-ac3c-cb74b06c8013 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.605735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.606578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.608218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.608677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.609533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:08.609991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.611671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bc90-9c4e-4150-a901-1172c5a5a707 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.621399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:08.626465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 357/696] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:08.628070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.628632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.629116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.648995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:08.650547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:08.735134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 358/697] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:08.735352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421696-f012-46f0-ac3c-cb74b06c8013 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.736740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.757833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:08.792288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.793294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.793786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.794794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.807555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.811291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:08.842225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:08.843197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:08.844171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:08.849309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 340/698] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:08.857738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:08.897599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9092ac-22cc-4d37-9ba6-2556d5f1f03a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:08.943364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:08.949895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:08.951802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.952577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.954225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.955184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=a9e4244f9ac349feb38fce19062e7c4b) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:08.955728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:08.957436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aed62-df5f-46a0-9cd8-067bef377dcf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:08.967185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 359/699] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/role_assignments?user.id=a9e4244f9ac349feb38fce19062e7c4b&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:08.969311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a621-630a-4dc0-b866-6e409be9273b None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.969802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a621-630a-4dc0-b866-6e409be9273b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.970720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a621-630a-4dc0-b866-6e409be9273b None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.972591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 360/700] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:08.989750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:08.990364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:08.990837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:08.999360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d1ed6-d75c-4286-8dc2-9ae7fd9bfbe5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.033418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:09.035314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:09.048273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.048273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.048273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.048273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.049023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:09.049023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.050001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.071184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 341/701] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:14:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:09.072333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.120276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:09.144228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 361/702] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:09.145151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.217631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc63c-2911-444c-8c69-2fd474fe14f1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.267299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.267952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.268577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.268857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.282217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.284177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.297914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be63164-00d6-408b-955d-4bac13e91969 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:09.305204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:09.306128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:09.307014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:09.307014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:09.307014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:09.307182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 342/703] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:09.315668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.327666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:09.350083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.351269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.351552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.351827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.445061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:09.453435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.455443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.455907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e386388-f1c4-4e0c-b1c4-620dd54f5a2f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.494400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.495216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.495595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.496157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.496753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:09.497311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.498872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.511623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 343/704] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:09.520000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.605212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 362/705] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:09.606144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.630600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:09.645839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b9658-740c-474f-af56-a82b481ca695 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.681100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.681716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.681997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.682271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.682926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.684388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.707808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 344/706] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:14:09 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:09.708601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.724261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:09.733154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe65142-5a1f-45d4-804c-143cf094a918 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.773192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.773964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.774307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.774691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.775347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.776833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-1e5257b7-7bd9-4414-8af8-2178bbbac57e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:09.788533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:09.789669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:09.790532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:09.795317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 363/707] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:09.796867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47a93-dbc8-47a2-8f50-30d50f489e33 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.797232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47a93-dbc8-47a2-8f50-30d50f489e33 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.797574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47a93-dbc8-47a2-8f50-30d50f489e33 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.803538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 364/708] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:09.804601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47a93-dbc8-47a2-8f50-30d50f489e33 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.873602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65725dc-b0b1-4e3d-99e9-27af61c34a94 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.900584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:09.919781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47a93-dbc8-47a2-8f50-30d50f489e33 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:09.921597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.922238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.922523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.922793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.935276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.936861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-34f47709-d993-4511-8432-c2230ad61881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:09.952117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:09.953122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:09.954258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:09.954258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:09.954258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:09.954258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 345/709] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:09.954950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.955231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.955500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.966086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:09.966635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:09.966924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:09.967191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:09.967825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:09.968131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:09.969581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:09.979717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 365/710] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:09.979717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:09.988211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:09.989427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:10.048214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:10.062963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 346/711] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:10.063802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.098199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57ef5e-35f1-490b-9e36-5e2a0d89191b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:10.137105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:10.137762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:10.138049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:10.138325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:10.138975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:10.139277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:10.140686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:10.268798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56544f9-c3af-4833-b42c-eb35367cdb5f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:10.330740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 366/712] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:10.336725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.353099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:10.353725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:10.354006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:10.354280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:10.354912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:10.355214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:10.357157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:10.360827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:10.374576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 347/713] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:10.436129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.469874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f319c4-b395-4d1e-bdad-af40a556ebb7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:10.509726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:10.510731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:10.511209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:10.511678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:10.520075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:10.521908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:10.534643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:10.535625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:10.536591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:10.539130 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 367/714] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:10.545965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.564694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:10.620648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec8910-ad2f-4ba5-8041-f8b501ee8c5c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:10.631301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:10.663285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:10.664554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:10.665220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:10.665633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] PATH_INFO: `/v3/services/network` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:10.666520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:10.668626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:10.674836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a895e84-b666-4a4c-9f03-ce428a279beb None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:10.683086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:10.684087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:10.684980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:10.687954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 348/715] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:10.693834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.744850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:10.745468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:10.745747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:10.746020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:10.746713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:10.747019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:10.749032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:10.779213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 368/716] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:10.785229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.883437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ccca1-27dc-4968-97ca-cad5fa194a0c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:10.915399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:10.952422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:10.953440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:10.954166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:10.954634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:10.955463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:10.955985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:10.957582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:10.968137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 349/717] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:10.974017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:10.975339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17184-e016-4524-9823-57ddfd72c86a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:11.036656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:11.053085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:11.053699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:11.053975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:11.054241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:11.054960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=880e3ed0ab1641a3bdab9ff349d09286) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:11.055264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:11.056713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3d9d-3b1a-4187-861f-8554e81ac84b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:11.067906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 369/718] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/role_assignments?user.id=880e3ed0ab1641a3bdab9ff349d09286&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:11.130988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb4af4-0164-4439-a0d9-0e3cd2b976b9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:11.181128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:11.181745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:11.182026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:11.182300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:11.182983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] RBAC: Adding query filter params (type=network) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:11.183290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:11.184755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c54467-92e1-45e5-a115-1c8e22c6a47d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:11.192488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 350/719] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:11.282650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ce3c-ea43-4528-a66e-18ef29789290 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:11.283168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ce3c-ea43-4528-a66e-18ef29789290 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:11.283168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ce3c-ea43-4528-a66e-18ef29789290 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:11.284866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 370/720] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:11.290713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:11.290994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:11.291188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:11.313473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:11.314687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:11.364191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:11.406778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 351/721] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:11.691659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ce3c-ea43-4528-a66e-18ef29789290 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:11.797076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ce3c-ea43-4528-a66e-18ef29789290 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:11.838380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d8084-829c-4ae5-9a9b-730abd3b8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:11.839049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8084-829c-4ae5-9a9b-730abd3b8dfd None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:11.839325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8084-829c-4ae5-9a9b-730abd3b8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:11.839591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8084-829c-4ae5-9a9b-730abd3b8dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:11.852786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8084-829c-4ae5-9a9b-730abd3b8dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-2d7d8084-829c-4ae5-9a9b-730abd3b8dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:11.857761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:11.858689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:11.859977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 371/722] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:11.865038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:12.036739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610261-ac2a-4da3-9bb6-53d665af4100 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.037063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610261-ac2a-4da3-9bb6-53d665af4100 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.037275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610261-ac2a-4da3-9bb6-53d665af4100 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.038609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 372/723] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:12.039527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184578-0fa4-43a5-8f65-8a7bb0f8f100 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:12.045385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.045665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.045883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.077344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:12.077958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.078235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.078502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.079420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:12.079719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:12.081114 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:12.089240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:12.090252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 352/724] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:12.090437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:12.102142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:12.163687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:12.188615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:12.221027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 373/725] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:14:12.282733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641db9-435c-47a1-8ae2-780fcd65df42 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:12.337941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:12.338576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.338852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.339118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.355847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:12.357917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:12.376374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:12.377456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:12.378919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:12.378919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:12.378919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:12.378919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 353/726] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:12.383106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:12.540053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4732e5-7048-4b1b-a1ac-82551e85d949 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:12.585972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:12.586595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.586874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.587190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.587841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:12.588140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:12.589607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:12.607105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 374/727] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:12.612594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:12.616777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:12.666553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:12.738430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:12.738871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8937e81-2c39-48b3-abd8-d85b4a6f35dd None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:12.756277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc576-9c24-47c4-9787-d84714ad3403 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:12.783464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295ab31-e51d-4d20-b38e-15fcca9f0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:12.784539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295ab31-e51d-4d20-b38e-15fcca9f0222 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.784996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295ab31-e51d-4d20-b38e-15fcca9f0222 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.785395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295ab31-e51d-4d20-b38e-15fcca9f0222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.796137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:12.796737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.797015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.797286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.798160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295ab31-e51d-4d20-b38e-15fcca9f0222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-5295ab31-e51d-4d20-b38e-15fcca9f0222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:12.804013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:12.805124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:12.806118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:12.809129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 375/728] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:12.810443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa6fe4-698c-4f38-b1b6-e8894aba4e49 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.810761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa6fe4-698c-4f38-b1b6-e8894aba4e49 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.811038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa6fe4-698c-4f38-b1b6-e8894aba4e49 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.812378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 376/729] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:12.815328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:12.816758 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa6fe4-698c-4f38-b1b6-e8894aba4e49 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:12.816933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f2e3fabd-2f29-4f5e-a0dd-b0008c343258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:12.833314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:12.834773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 354/730] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:12.836849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:12.837728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:12.867024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:12.868271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:12.951224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa6fe4-698c-4f38-b1b6-e8894aba4e49 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:12.953495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:12.958851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 355/731] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:12.959728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.002605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.002605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.003035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.003169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.005070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:13.005470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.012610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.029650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 377/732] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:13.034531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.107983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:13.149525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2610b-8c6c-444d-8b4e-ef244a555701 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:13.222436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.224026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.224371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.226950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.227725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:13.228065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.232115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.235961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d5e1b-5c74-45ee-83f3-38b33e568f4c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:13.260976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 356/733] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 17 19:14:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:13.267959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.310011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.311815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.312303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.312722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.328464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.330550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:13.352485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:13.353637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:13.354727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:13.354727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:13.354727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:13.356447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 378/734] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:13.357629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.383180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:13.386905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0b7e2-88cc-4044-a980-fdaac773ad89 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:13.425479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f88ed-2397-4e79-a2ec-a1813f54792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.426514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f88ed-2397-4e79-a2ec-a1813f54792b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.427023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f88ed-2397-4e79-a2ec-a1813f54792b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.427534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f88ed-2397-4e79-a2ec-a1813f54792b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.432335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:13.484938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d43b6-fc4c-4571-90dc-80024189ea43 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:13.519828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.520736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.521183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.521636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.522461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.524002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.526390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f88ed-2397-4e79-a2ec-a1813f54792b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.528153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f88ed-2397-4e79-a2ec-a1813f54792b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.547921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 379/735] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:13 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:13.557616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.659346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:13.661626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 357/736] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:14:13.663107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93c5a0-b865-484b-8eef-0c6ba1acd454 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.663403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93c5a0-b865-484b-8eef-0c6ba1acd454 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.663677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93c5a0-b865-484b-8eef-0c6ba1acd454 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.668312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 358/737] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:13.668312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f590ca-9056-49a4-8e07-33478cdd1df5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.668312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f590ca-9056-49a4-8e07-33478cdd1df5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.668312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f590ca-9056-49a4-8e07-33478cdd1df5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.672014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 359/738] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:13.672014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f590ca-9056-49a4-8e07-33478cdd1df5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.698537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91948-6f1e-480f-bc3b-11aaacbc7ec6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:13.717297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:13.739830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.740503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.740954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.741381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.742024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:13.742328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.744769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553b9fe-6f03-4159-aa40-93b18688469a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.757407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 380/739] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:13.758782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee885f-9850-4aeb-9fd8-ea8c4a80325a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.759071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee885f-9850-4aeb-9fd8-ea8c4a80325a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.759341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee885f-9850-4aeb-9fd8-ea8c4a80325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.778841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-bfee885f-9850-4aeb-9fd8-ea8c4a80325a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:13.780405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bfee885f-9850-4aeb-9fd8-ea8c4a80325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:13.791448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f590ca-9056-49a4-8e07-33478cdd1df5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:13.833549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:13.834191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.834478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.834755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.847651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:13.849130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:13.859521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 381/740] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:13.859521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:13.859521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:13.859521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:13.873649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:13.874858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:13.876472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:13.877361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:13.878252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:13.878252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:13.878252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:13.878252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 360/741] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:13.878860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.951606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:13.967810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 382/742] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:14:13.969166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:13.992147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.027498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85ba2-8d3f-491d-b313-91f0b5c9d2c0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.066289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.067161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.067499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.067780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.078100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.079790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:14.093808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:14.096000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:14.098271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 361/743] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:14:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:14.104281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.175819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7216d3d-2bf9-44e5-8ba2-33522811a4fe None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.214131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.214968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.215398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.216001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.216844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:14.217293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.218974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.232513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 383/744] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:14.233900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.242320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d123c79-d346-4fe2-a178-8ec7f223526e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.277293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.277907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.278211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.278573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.279361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:14.279661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.281338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.293636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.301039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 362/745] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:14.302085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.312334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.351438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f68e7d-fa1d-4d1c-99d1-38fcaac2b99d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.386203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.386806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.387074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.387344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.388545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.390332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.405884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 384/746] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:14 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:14.406833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.417159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6821-607f-4ede-bf30-283c98eff0b2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.473303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.474445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.475301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.475794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.487102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.489279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:14.504928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:14.505904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:14.506826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:14.514703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 363/747] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:14.515918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.547297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63980a-2cdb-4423-bd1a-556630e18cf2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.565232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.591957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.592661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.592943 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.593222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.599846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.605877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:14.611918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:14.613073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:14.614101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 385/748] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:14.614794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.658452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed2fa-1b0b-47e4-bdd7-88571c5dcecb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.715056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.717380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.718282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.718803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.725740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e9d2-50cf-4401-902f-1cedb20af86d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.774931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:14.776296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:14.776994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:14.777484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:14.779503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:14.780779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.783616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.800455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:14.802069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:14.807156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 386/749] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:14.807156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.854274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.874750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:14.920231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 364/750] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:14:14.921558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:14.946701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55773634-573b-49ef-aea7-1056d1bd2fd5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:14.999485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.006939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.007772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.008303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.009444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:15.009931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.012069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.024875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 387/751] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:15.026351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.030821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c1ed-3e66-47b3-a6fb-1959a43f6df2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.067841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.068630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.069005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.069346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.070141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=a9e4244f9ac349feb38fce19062e7c4b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:15.070516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.072015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.084277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 365/752] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:14 2022] GET /identity/v3/role_assignments?user.id=a9e4244f9ac349feb38fce19062e7c4b&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:15.084277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.159006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:15.162436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:15.169630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7c37-74bf-46e8-982c-5cc2c4c7bd3c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.218512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.219171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.219450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.219720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.248289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.249805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:15.273136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:15.274142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:15.275589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:15.275589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:15.275589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:15.275589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 388/753] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:15.281323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.282343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8973-b8c0-4414-921f-99c2e337a1ff None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.331052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.332053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.332569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.333041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.346159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.348035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:15.364267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:15.365261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:15.366138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:15.366138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:15.366138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:15.368493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 366/754] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:15.374763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.476417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610dcf7-7fba-4f0b-b3f3-c04010040241 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.525972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.526610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.526896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.527173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.527824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:15.528136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.532973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.555802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 389/755] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:15.562519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.573480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:15.576652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:15.623463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1292c-3fc3-419e-a2fd-b3f078e2744a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.671797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.672727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.673156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.673574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.674360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:15.674825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.676437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb77b-fedb-4fda-9014-824f95c9ff6c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.689572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 367/756] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:15.691016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a97d3-afe7-4ca0-82bc-c8b80df7acfe None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.691448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a97d3-afe7-4ca0-82bc-c8b80df7acfe None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.691867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a97d3-afe7-4ca0-82bc-c8b80df7acfe None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.693709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 368/757] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:15.694627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a97d3-afe7-4ca0-82bc-c8b80df7acfe None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.720706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120c6e-5714-49f6-b1b9-1d1311ce9ec6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.757345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.757870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.758157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.758430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.766088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.767592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-21868baf-eac7-43fd-bc85-11b09710bb70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:15.780607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:15.781562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:15.782434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 390/758] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:15.783332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.783434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.783693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.801754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:15.802849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:15.811567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a97d3-afe7-4ca0-82bc-c8b80df7acfe None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:15.850166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:15.851183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:15.851664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:15.852137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:15.860453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:15.862176 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:15.864199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:15.867483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:15.877571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 391/759] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:15.878532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:15.879432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:15.880388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:15.880950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:15.883366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 369/760] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:15.893894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.014512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c05a-81fe-45f6-aafb-156832eaefa2 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.067365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bad47-26b9-46f5-9f1d-b25fa9c5068f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.067551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.068123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.068433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.068710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.069414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:16.069722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.071168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.098550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 392/761] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:16.104452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.116993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.117657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.117940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.118212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.119009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:16.119314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.120884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.156023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 370/762] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:14:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:16.161302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.168314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:16.247742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320937a-26be-49fe-9e8b-ca147d02d571 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.273348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:16.307343 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.307968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.308269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.308563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.309310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=0fabcbac1c744d918621344b3dc8a3ce) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:16.310199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.311785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.319221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 393/763] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/role_assignments?user.id=0fabcbac1c744d918621344b3dc8a3ce&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:16.325545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.343421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d14d4-e117-4683-b4c3-717fd61b5705 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.384687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.385332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.385713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.385997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.399238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.400821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:16.417612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:16.420113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:16.421374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:16.421374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:16.421374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:16.421374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 371/764] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:16.425119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.471547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68572-d495-46aa-a3ef-d97206e7ca63 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.493540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:16.509787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.510620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.511080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.511456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.512364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.514358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e328faee-f352-4cbd-8c55-e68a0d51bb17 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:16.524313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:16.526695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:16.529144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 394/765] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:16.532225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5b58-f0c0-4d4b-9930-89eaf0556822 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.532225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5b58-f0c0-4d4b-9930-89eaf0556822 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.532225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e5b58-f0c0-4d4b-9930-89eaf0556822 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.532225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 395/766] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:16.536472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e5b58-f0c0-4d4b-9930-89eaf0556822 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.580842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec00f1e-1d53-4ce5-b61b-e95a301890d7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.593403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:16.628580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.629984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.630565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.631026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.632011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:16.632520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.634725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7b17e-ce73-4153-9802-99a99e7af217 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.655189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 372/767] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:16.655189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.655189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.655189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.663979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e5b58-f0c0-4d4b-9930-89eaf0556822 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.676221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:16.677811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:16.702505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.703124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.703406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.703924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.704601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:16.705035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.706405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.711598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 396/768] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:16.716740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.757362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 373/769] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:16.759439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.777101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:16.846258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f4fa3-b4af-42d3-ac0b-77f88628a47a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.894549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.896476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.898060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:16.898539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:16.911574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:16.914356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:16.938755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:16.939727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:16.940671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 397/770] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:16.946619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:16.954435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57e26-dc05-414e-b1c5-5c483f29d142 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:16.968458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:16.998226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:16.999207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:16.999707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.000186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.001113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:17.001618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.003469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.010996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 374/771] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:17.016955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.140898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67d5bc-1f1e-4cd7-bb80-945409c8dba9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.183487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7104b-3661-466c-a351-d3c3ba609c79 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.183725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.184200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.184613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.184880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.185686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] RBAC: Adding query filter params (interface=public, service_id=996e237a8eb54805bbf8c187be644488, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:17.186095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.187487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.193381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:17.197485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 375/772] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/endpoints?service_id=996e237a8eb54805bbf8c187be644488&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:17.198419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.222141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.222917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.223329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.223699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.224574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:17.224981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.226614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.228938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:17.241205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 398/773] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:17.242309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.311904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55520-2cb8-40a5-8555-8836db4f3d1f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.346788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.347388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.347671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.347940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] PATH_INFO: `/v3/services/network` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.348544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.349900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.350095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f1b2-0573-4801-b66c-a04cc310807c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:17.359180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:17.360383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:17.361348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:17.367955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 376/774] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:17.367955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.386106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba9b00-60ef-4422-b442-76e9314a9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.386725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9b00-60ef-4422-b442-76e9314a9bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.387005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9b00-60ef-4422-b442-76e9314a9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.387278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba9b00-60ef-4422-b442-76e9314a9bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.388978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9b00-60ef-4422-b442-76e9314a9bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.390464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba9b00-60ef-4422-b442-76e9314a9bd1 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.408981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 399/775] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:17.416326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36aac7-eb5c-482e-b567-bae1731a16a8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.416326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36aac7-eb5c-482e-b567-bae1731a16a8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.416326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36aac7-eb5c-482e-b567-bae1731a16a8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.416326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 400/776] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:17.416326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36aac7-eb5c-482e-b567-bae1731a16a8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.469024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:17.489364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:17.503799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508f10-39c0-423f-8967-bb2cb12b3743 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.548030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f3904-975a-46ea-a2e0-d976fbcaa88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.548724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f3904-975a-46ea-a2e0-d976fbcaa88d None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.549007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f3904-975a-46ea-a2e0-d976fbcaa88d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.549276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f3904-975a-46ea-a2e0-d976fbcaa88d None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/880e3ed0ab1641a3bdab9ff349d09286/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.551881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f3904-975a-46ea-a2e0-d976fbcaa88d None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=880e3ed0ab1641a3bdab9ff349d09286, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.553355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f3904-975a-46ea-a2e0-d976fbcaa88d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.561006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36aac7-eb5c-482e-b567-bae1731a16a8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.569256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 377/777] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:17 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/880e3ed0ab1641a3bdab9ff349d09286/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:14:17.573703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.574602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.575028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.602118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:17.603609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:17.606580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.607661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.608078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.608545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.609436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] RBAC: Adding query filter params (name=network) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:17.609906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.611570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.618289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 401/778] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:17.624144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.712362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 378/779] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:17.754494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:17.761249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54d30-4fe8-43f0-a0cc-70de70b668ea None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.797107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.797779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.798064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.798338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.798970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] RBAC: Adding query filter params (type=network) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:17.799271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.800677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.807292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 402/780] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:17.813349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.905045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:17.931103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f7ef-c028-4a24-9ccd-ad380ebf6a19 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:17.980285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:17.981017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:17.981976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:17.982344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:17.985123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] RBAC: Adding query filter params (interface=public, service_id=55d1cea92d32469a94c8e10b7ab39367, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:17.985123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:17.985123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:17.993591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:17.997607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 379/781] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/endpoints?service_id=55d1cea92d32469a94c8e10b7ab39367&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:18.003190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:18.156020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d91fc-8c29-4852-9d04-f3a341b14b1e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:18.189364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c513cb-a873-4e6f-9579-722dd48326dc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:18.191689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:18.192393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.192677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.192956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.203406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:18.208891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:18.210010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:18.211124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 403/782] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:18.216683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:18.244697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:18.249160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:18.249784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.250065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.250340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.250952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:18.252344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:18.259951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 380/783] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:18 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:18.363793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6de85-8d05-409a-8c95-2b8b2a03cd9b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:18.402001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:18.402630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.402911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.403415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.404371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:18.404687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:18.406141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:18.416707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 404/784] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:18.425414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:18.438337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:18.554520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7910a7-ec84-4c93-9085-407989c45d24 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:18.591389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:18.592103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.592412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.592683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.603224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:18.604716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5b03a2c5-c67a-4b42-b56a-f06c0cf78431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:18.619732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:18.620736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:18.622024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:18.622024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:18.622024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:18.622024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 381/785] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:18.627910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:18.681717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24bb-95bd-40e3-aa09-7837c28f6d22 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.682057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24bb-95bd-40e3-aa09-7837c28f6d22 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.682279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a24bb-95bd-40e3-aa09-7837c28f6d22 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.683850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 382/786] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:18.690796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.691088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.691368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.711062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:18.720269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:18.736657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:18.756642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01609c-1b8b-4bfa-a136-965122469be8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:18.797513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:18.798535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.799015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.799482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.800357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:18.800859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:18.802924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:18.810158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:18.818641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 405/787] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:18.824280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:18.851356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 383/788] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:18.933789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8f357-95dd-4328-90eb-d113bf314e87 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:18.969982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:18.970980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:18.971459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:18.971947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:18.980111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:18.981878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:18.993832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:18.994769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:18.995704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:18.998848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 406/789] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:19.004756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.111820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019bd67-3b9c-4c49-a9df-235ec3178df5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:19.147959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:19.148611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:19.148892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:19.149167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:19.149896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:19.150199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:19.151627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:19.167550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.170198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 384/790] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:19.175506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.176356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:19.227715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:19.282695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2e95-1fe5-4ed5-a646-3fd1d1849f3c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:19.284328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b2772-fcc4-4e41-901a-feaf57c05a38 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:19.320729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:19.321368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:19.321642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:19.321915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:19.322235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:19.323139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:19.323614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:19.324081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:19.332643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:19.334083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:19.336671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:19.343228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:19.344172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:19.345024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:19.347620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 407/791] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:19.352016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:19.352985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:19.353866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:19.353866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:19.353866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:19.353866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 385/792] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:19.355998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.356124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.444418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:19.500583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b481-43e6-4149-9e5b-1949eb902ab6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:19.526988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:19.531656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a929edb-5c3a-4d1d-9a96-3abf1380ae8b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:19.540761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:19.541599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:19.542081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:19.542496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:19.543278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:19.544871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:19.546466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:19.560010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 408/793] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:19.566149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.610042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:19.610659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:19.610937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:19.611211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:19.611883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:19.612183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:19.614806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:19.627477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 386/794] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:19.639968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.795056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bff8d-ca03-42d7-aee6-af003831ab50 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:19.851118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:19.877536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:19.878181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:19.878460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:19.878804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:19.892228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:19.893838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:19.908422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:19.909358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:19.910235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:19.912098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 409/795] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:19.923175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:19.993421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cac4a-f6e5-4136-92fe-dfecb73a8643 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.043096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.044308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.044604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.044858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.058205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.061289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9ea1d38e-9c24-40e7-9114-7a6335396599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:20.076970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:20.077967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:20.079158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:20.079158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:20.079158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:20.079158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 387/796] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:20.080710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e2d0e-a2ac-425d-b2b8-082790d3f030 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.080710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e2d0e-a2ac-425d-b2b8-082790d3f030 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.080710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e2d0e-a2ac-425d-b2b8-082790d3f030 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.085816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 388/797] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:20.085816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e2d0e-a2ac-425d-b2b8-082790d3f030 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.101270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:20.102636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7178-4a03-47bf-b6b8-d3528fa5644d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.140137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.141010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.141447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.141712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.142510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:20.142812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.144268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de412eb6-42d5-41c2-ba7e-2f059f15b559 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.157057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 410/798] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:20.158320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104bd3-526d-48c5-88bf-deea7dc91365 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.158601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104bd3-526d-48c5-88bf-deea7dc91365 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.158869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104bd3-526d-48c5-88bf-deea7dc91365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.177027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-23104bd3-526d-48c5-88bf-deea7dc91365 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:20.178205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-23104bd3-526d-48c5-88bf-deea7dc91365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:20.203265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e2d0e-a2ac-425d-b2b8-082790d3f030 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.218254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:20.239929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.240635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.240918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.241188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.241883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:20.242187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.243538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.254247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 411/799] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:20.255767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b385b56-67aa-4b9c-b174-b0d7bb52cd25 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.256285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b385b56-67aa-4b9c-b174-b0d7bb52cd25 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.256805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b385b56-67aa-4b9c-b174-b0d7bb52cd25 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.262248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 389/800] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:20.262248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.263230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 412/801] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:20.264321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b385b56-67aa-4b9c-b174-b0d7bb52cd25 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.343297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:20.375444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a157d-bede-424a-8f6a-0a1a7e46e234 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.387199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b385b56-67aa-4b9c-b174-b0d7bb52cd25 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.411940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd5e7d-661c-4c93-a4fc-78c943091922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.412840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd5e7d-661c-4c93-a4fc-78c943091922 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.413262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd5e7d-661c-4c93-a4fc-78c943091922 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.413630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd5e7d-661c-4c93-a4fc-78c943091922 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/a9e4244f9ac349feb38fce19062e7c4b/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.415778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd5e7d-661c-4c93-a4fc-78c943091922 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=a9e4244f9ac349feb38fce19062e7c4b, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.417414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd5e7d-661c-4c93-a4fc-78c943091922 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.431818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.432822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.433351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.433880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.437752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 390/802] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:20 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/a9e4244f9ac349feb38fce19062e7c4b/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:14:20.439992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.440299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.440580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.452171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.455506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:20.484617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:20.485681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:20.486591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:20.489317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:20.490774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 413/803] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:20.492571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:20.496626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.580079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:20.586278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 391/804] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:20.589146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.683577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:20.687209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad0429-66d9-4475-bd13-38c89282b5e8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.730654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.731335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.731780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.732057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.733151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:20.733724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.735167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.735592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cf2d2-ec8a-4c18-a503-414453ddc045 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.758030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 414/805] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:20.764184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.783434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.784087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.784426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.784706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.785299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.786661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:20.802306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:20.803302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:20.804709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 392/806] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:20.812086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:20.880564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:20.901809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b457224-35c9-45c2-b3b8-6cfe896ac20e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:20.939831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:20.940428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.940708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.940982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.951710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:20.953183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-ca705787-4bff-45fe-bad7-a591836ae391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:20.968700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:20.970855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:20.972960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:20.972960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:20.972960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:20.972960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 415/807] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:20.976965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4cf52-f613-49d1-9d79-0a714bcc930f None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:20.977253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4cf52-f613-49d1-9d79-0a714bcc930f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:20.977529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4cf52-f613-49d1-9d79-0a714bcc930f None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:20.978959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 416/808] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:20.980359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4cf52-f613-49d1-9d79-0a714bcc930f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.008351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409146cb-c8a8-4d53-b67d-e09f4ab4dd27 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.035873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.045592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.046199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.047993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.048315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.048950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:21.049253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.050612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355c60a-f61f-47d0-bffb-b657c34a438e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.055490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 393/809] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:21.056497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.056777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.057046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.075543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:21.076736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:21.098412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4cf52-f613-49d1-9d79-0a714bcc930f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.141455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.142180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.142678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.142788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.143331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:21.143626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.145010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.147128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 394/810] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:21.147839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.168050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 417/811] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:21.169871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.174931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.279351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f74f99-777d-4d84-9e9d-735199af55b2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.290513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb257011-e15e-46c4-b552-3123de420b4b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.318292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.323224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.323843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.324162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.324478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.326724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:21.327040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.328956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.334564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.335448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.335940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.336046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 418/812] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:21.336532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.336833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.348576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:21.354019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:21.354933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:21.355776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:21.358682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 395/813] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:21.359735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.425725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.471884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a795a-97f1-4f1b-b8ed-333fafbb09ed None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.475268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9dbd3-33f1-49ab-91cc-d53ecb29a054 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.508384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.509280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.509764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.510208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.511996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.513171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.513496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.513773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.514433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.515805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.518686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.520305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:21.532575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:21.533428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:21.534308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:21.536016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 419/814] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:21.536929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.544304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 396/815] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:21.544304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.602796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.679188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf031be5-f64c-40dc-82f1-db5522c44cc7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.710260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae206-e107-4418-a9b4-49d5dd4213fe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.715591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.724906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.726009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.726009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.726210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.727053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:21.727053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.729177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.738783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 420/816] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:21.739675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.762949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.764056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.764575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.765113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.765779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.767436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:21.777567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:21.778601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:21.783971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 397/817] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:21.784848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.864860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba23ce-3d49-4b45-ad6d-0abd039637d1 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.897220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:21.902412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39399-7ffb-42b1-9922-96f46a6ae3d9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:21.913099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.913721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.914004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.914280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.915461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:21.915771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.918019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.936377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 421/818] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:21.937264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:21.954052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:21.954799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:21.955088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:21.955362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:21.968524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:21.970220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:21.988556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:21.989527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:21.990823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:21.990823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:21.990823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:21.990823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 398/819] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:21.990823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.000591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:22.054492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6bd4-5a80-431e-930d-635750ed8622 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.092298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.092930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.093257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.093552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.094280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] RBAC: Adding query filter params (name=network) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:22.094600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.096058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.101540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 422/820] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:22.102207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.111858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89f09-7a73-47c6-b0cd-fbd2a15928fe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.150466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.151411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.151840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.152414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/0fabcbac1c744d918621344b3dc8a3ce/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.170354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=0fabcbac1c744d918621344b3dc8a3ce, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.172595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.186976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:22.200544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 399/821] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:21 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/0fabcbac1c744d918621344b3dc8a3ce/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:14:22.202618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.219216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35de25-a1b9-4613-b5fb-d12d2b1be703 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.240389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:22.306188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.306729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.307004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.307267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.307913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:22.308210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.309662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.337832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 423/822] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:22.343933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.365874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977df57-6e42-40a9-a83d-cf3a2423303a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.437205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.437822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.438099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.438369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.439000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] RBAC: Adding query filter params (type=network) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:22.439296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.440695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.448943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 400/823] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:22.454314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.511054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efe58e-84fa-4042-83d0-e91a552535f5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.524821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:22.565670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.567297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.567767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.568221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.586914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b04c-48fb-45a3-b78e-937c4fda0f0c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.589148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.591357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:22.605542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:22.606829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:22.607888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:22.610389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 424/824] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:14:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:22.615610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.661248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa436b8-d25f-47bc-8eed-e0fa8ca30b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.661873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa436b8-d25f-47bc-8eed-e0fa8ca30b90 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.662158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa436b8-d25f-47bc-8eed-e0fa8ca30b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.662437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa436b8-d25f-47bc-8eed-e0fa8ca30b90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.663118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa436b8-d25f-47bc-8eed-e0fa8ca30b90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.664916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa436b8-d25f-47bc-8eed-e0fa8ca30b90 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.671554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:22.691253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 401/825] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:22.692762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcca43-baf5-4018-b1b5-6e6965f4f39e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.693146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcca43-baf5-4018-b1b5-6e6965f4f39e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.693483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcca43-baf5-4018-b1b5-6e6965f4f39e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.695290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 402/826] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:22.702502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.702822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.703101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.725909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:22.726821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:22.756748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81608bf-8dcb-4b2f-ae9e-47cb124d9a8c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:22.804996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:22.806103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:22.806698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:22.807190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:22.808131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:22.808706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:22.811450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:22.812120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 403/827] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:22.833916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 425/828] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:14:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:22.840293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:22.925550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:22.999623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a5859-c51a-40c8-a0a8-c945bee67119 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.045463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.046430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.046912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.047384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.123981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:23.125794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:23.187934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:23.199116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.247261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 404/829] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:14:23.253852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.309935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:23.334434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95cae3-b4f0-49d8-ba8d-272ee5122598 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.377504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a86e67-4c06-4650-b09e-80efd4e432de None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.384270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.385090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.385549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.385965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.400320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:23.407348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:23.408333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:23.409152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:23.414447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 426/830] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:23.415538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.428336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.428978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.429264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.429537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.443070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:23.444827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:23.467016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:23.467991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:23.468967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:23.468967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:23.468967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:23.471031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 405/831] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:23.484302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.484302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:23.562465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13251-720e-42cf-bd31-f59965c4fb32 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.592481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d7b3-69ff-4a28-b914-00abd718c40f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.616768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.617421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.618003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.618286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.618988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:23.619295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:23.623351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:23.633799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.634728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.635206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.635706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.640546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 427/832] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:23.640674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:23.640674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:23.640674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8746a-5ee0-412d-81bd-d6b1fff5fbdd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:23.642258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.656029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:23.656657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 406/833] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:23.657947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067f9c-6b27-41f2-a692-50a5f26abefc None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.658240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067f9c-6b27-41f2-a692-50a5f26abefc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.658513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067f9c-6b27-41f2-a692-50a5f26abefc None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.660303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 407/834] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:23.661841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89067f9c-6b27-41f2-a692-50a5f26abefc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.734062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:23.758209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a7a9-67e7-4940-861c-405fa1429600 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.777127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89067f9c-6b27-41f2-a692-50a5f26abefc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:23.792981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.793640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.793921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.794302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.804889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:23.806315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:23.817221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:23.817853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.818133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.818404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-9c7daa99-fc15-4cf7-b7ea-2e0939adc920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:23.820472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:23.821678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:23.822580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:23.822580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:23.822580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:23.827246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 428/835] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:23.828268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:23.828555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:23.828961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:23.829117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:23.830400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:23.843811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:23.844921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 408/836] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:23.845805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.853191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:23.854386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:23.915079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:23.928460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 429/837] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:23.929558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:23.969513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1444788-347c-469f-9eb8-5f4f58251274 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.007372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.024776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.026342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.026838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.027307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.028485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:24.029023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.031718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.047927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 409/838] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:24.053543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.067402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaacb5-4e14-4cb8-87e2-ac5ea54358e4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.113856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.115216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.115919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.116392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.117499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:24.117954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.119915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.137005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 430/839] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:24.142568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.178257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6ff8-e9b4-4cd3-a6c0-cc702c112594 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.198724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.220143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.220816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.221114 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.221371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.228884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.230313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:24.242784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:24.243732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 410/840] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:24.245187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.258546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badea32-efb0-461d-9041-f1926397aa91 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.293242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.294984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.295664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.296124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.296454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.297174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=880e3ed0ab1641a3bdab9ff349d09286) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:24.297487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.298928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.305335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 431/841] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/role_assignments?user.id=880e3ed0ab1641a3bdab9ff349d09286&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:24.306038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.392306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721e3ac-9e49-4d07-9196-52093b41bbe8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.438811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5fa37-13d8-4e1b-86d8-ebb142cd1945 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.439004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.439423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.439704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.440037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.440662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.442132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d8391139-bd4d-4eed-859d-1060f7f55790 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:24.452206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:24.453492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:24.454654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:24.458566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 411/842] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:24.459891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbc5fd-9c65-41ab-9413-47729adf099f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.460179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbc5fd-9c65-41ab-9413-47729adf099f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.460497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbc5fd-9c65-41ab-9413-47729adf099f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.461781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 412/843] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:24.462543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbc5fd-9c65-41ab-9413-47729adf099f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.464572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.497649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.498690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.499112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.499391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.500144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:24.500498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.501998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29da85f-68ed-4474-a1fe-425fc7486bd4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.521239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 432/844] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:24.522486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.522776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.523053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.541664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:24.542855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:24.585636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbc5fd-9c65-41ab-9413-47729adf099f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.594067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.617366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 433/845] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:24.618436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.623637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.624406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.624689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.625037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.625775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:24.626760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.627536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.636609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 413/846] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:24.639362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.736488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caffc6-1350-480b-9a17-67c3086cfac4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.737912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.763007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff8d49-9b2b-4989-8cf6-13155af1e021 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:24.774623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542626a8-684a-4c42-9911-409562059149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.775581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542626a8-684a-4c42-9911-409562059149 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.776161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542626a8-684a-4c42-9911-409562059149 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.776659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542626a8-684a-4c42-9911-409562059149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.798684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:24.799303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:24.799583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:24.799860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:24.800524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:24.800824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.802178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.808676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 414/847] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:24.862741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542626a8-684a-4c42-9911-409562059149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:24.864530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542626a8-684a-4c42-9911-409562059149 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:24.913634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.954426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:24.988438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 434/848] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:14:24.990611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542626a8-684a-4c42-9911-409562059149 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:24.993099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.055984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4a08-2cc6-4324-a8b8-0a23fa63ea3c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.107645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.108576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.108861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.109558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.118291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542626a8-684a-4c42-9911-409562059149 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.123448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:25.130134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:25.131069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:25.131889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 415/849] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:25.141233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.156497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.157142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.157424 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.157696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.169885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.171406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:25.186876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:25.187849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:25.189182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:25.189182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:25.189182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:25.189182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 435/850] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:25.194077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.258089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.267337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.269550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140639f-c242-4ce3-8022-754c9df71a23 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.307541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.308452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.308881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.309335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.310139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:25.310585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.312231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.325965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a998d0-2b5e-4beb-9b9f-fe862747e972 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.326474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 416/851] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:25.327499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.363432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.364141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.364520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.364865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.365578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:25.365956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.367522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.385049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 436/852] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:25.387069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.457846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583286-9bb9-41a6-8291-e928facaeec7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.499703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6402d2-402e-46e1-b4e8-1a183f3f4ac9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.502968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.503829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.504324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.504775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.516527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.520852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.523099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.540437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.541076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.541358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.541630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:25.546561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:25.547492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:25.548425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:25.548425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:25.548425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:25.554759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 417/853] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:25.555186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.556670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.557624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:25.569159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:25.570064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:25.570952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:25.575888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.576058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 437/854] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:25.577912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.688882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a765c3-66f9-4876-9419-92336daeffd7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.698406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa830a93-e4b1-402f-ab98-87cefab2ac22 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.727601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.728213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.728542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.728815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.729506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:25.729811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.731482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.748368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 438/855] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:25.749743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.750474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.750852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.751152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.751260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.752106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:25.752525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.754293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.772742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 418/856] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:25.778457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:25.799499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.863276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:25.886893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f7786-afa2-4229-9f4d-3e9a8249bd3a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.908384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308042-c876-48a0-b045-f8f2f3aaf553 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:25.927958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.928918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.929457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.929905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.931240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=a9e4244f9ac349feb38fce19062e7c4b) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:25.931999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.934149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.943007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 439/857] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/role_assignments?user.id=a9e4244f9ac349feb38fce19062e7c4b&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:25.948508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93929120-32c7-4247-a410-545e5b943362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:25.948508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93929120-32c7-4247-a410-545e5b943362 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:25.948508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93929120-32c7-4247-a410-545e5b943362 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:25.948508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93929120-32c7-4247-a410-545e5b943362 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:25.955809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93929120-32c7-4247-a410-545e5b943362 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:25.957796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93929120-32c7-4247-a410-545e5b943362 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-93929120-32c7-4247-a410-545e5b943362 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:25.971842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:25.973128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:25.974272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:25.976988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 419/858] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:25.987199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.099322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:26.104825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c5a9-c395-4bef-a4a6-4f2aa4ab400e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:26.142529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:26.143291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.143669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.144036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.144931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:26.145331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:26.146836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804cad-9e84-4f44-927c-3ac20f2d56f0 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:26.165903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 440/859] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 17 19:14:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:26.173083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93929120-32c7-4247-a410-545e5b943362 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0bca-9f22-4807-aeba-c525f1620bd2 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.270561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0bca-9f22-4807-aeba-c525f1620bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.270820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0bca-9f22-4807-aeba-c525f1620bd2 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.272529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 441/860] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:26.277965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.278105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.278452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.287310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93929120-32c7-4247-a410-545e5b943362 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:26.297230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:26.298520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:26.317786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:26.326921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:26.327731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.328012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.328308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.388417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 442/861] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:26.408986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:26.410805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:26.518816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 420/862] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:14:26.524789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.617065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:26.633030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcc22-77c7-4d00-8896-095f53f167d3 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:26.670459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:26.671022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.671304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.671576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.681974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:26.683559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:26.691769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:26.699211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:26.700384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:26.701279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:26.701279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:26.701279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:26.701445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 443/863] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:26.707912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.731569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:26.821932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d447fa-57d5-4b40-86a3-1aa7358584b0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:26.823930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b16119-618d-4821-a4b3-c53abc01fa2b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:26.863927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:26.865671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.865950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.866221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.866800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:26.868149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:26.876773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:26.877665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.878145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.878649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.879489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:26.879977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:26.880929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:26.882227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 421/864] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Aug 17 19:14:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:26.883349 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:26.888509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b592cd-f73a-4b4b-9834-908e064e32ec None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:26.888639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.895188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:26.901774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 444/865] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:26.904014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676322-2623-44cd-a73c-d4f24a15282e None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:26.904306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676322-2623-44cd-a73c-d4f24a15282e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:26.904580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676322-2623-44cd-a73c-d4f24a15282e None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:26.905925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 445/866] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:26.909857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04676322-2623-44cd-a73c-d4f24a15282e None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:26.998480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:27.010046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a2db-4b5b-4c37-902f-cf178f5924bc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:27.023488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04676322-2623-44cd-a73c-d4f24a15282e None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:27.048722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:27.049330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.049946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.049946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.050487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:27.050791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:27.052146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe660c-1afc-45e6-a0e1-24c06bfb591b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:27.057045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 422/867] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:27.058266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.058552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.058845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.067336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:27.068219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.068732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.069180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.077186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:27.077436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:27.078625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:27.079499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:27.095076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:27.095994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:27.096904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 446/868] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:27.097930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:27.157815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 423/869] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:27.158013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:27.166780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:27.204893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca428-3e67-4b2c-9793-3cda661ed59c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:27.242670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:27.243929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.244393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.245097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.245863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:27.246456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:27.249340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:27.257408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 447/870] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:27.290362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:27.308102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc2aa-c683-4a73-be08-36a4dec7ac69 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:27.347798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:27.348714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.349132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.349541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.350427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:27.350872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:27.352486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:27.366332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 424/871] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:27.372520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:27.472222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:27.483211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c347809-d70e-47f2-9eed-2d0f73a3f056 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:27.513077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:27.528725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:27.529444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.529806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.530149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.530942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=0fabcbac1c744d918621344b3dc8a3ce) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:27.531314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:27.532933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08337-caa1-45de-a1db-9f6374aea3d7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:27.544489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 448/872] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:27 2022] GET /identity/v3/role_assignments?user.id=0fabcbac1c744d918621344b3dc8a3ce&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:27.588754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5317c2-d8e8-4841-8f7a-0e7bcd0c5add None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:27.628895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d4e9a-0ce1-4b46-a0ea-ca62315ee12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:27.629892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d4e9a-0ce1-4b46-a0ea-ca62315ee12d None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:27.630347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d4e9a-0ce1-4b46-a0ea-ca62315ee12d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:27.630813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d4e9a-0ce1-4b46-a0ea-ca62315ee12d None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:27.631643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d4e9a-0ce1-4b46-a0ea-ca62315ee12d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:27.633219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d4e9a-0ce1-4b46-a0ea-ca62315ee12d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:27.654048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 425/873] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:27 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:28.011724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8d41-ae5a-4549-8fc2-5de7f50afccb None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:28.012015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8d41-ae5a-4549-8fc2-5de7f50afccb None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:28.013013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8d41-ae5a-4549-8fc2-5de7f50afccb None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:28.014634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 449/874] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:28.019884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:28.020379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:28.020554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:28.037743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:28.043408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:28.045377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:28.122704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 426/875] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:28.392025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8d41-ae5a-4549-8fc2-5de7f50afccb None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:28.505359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8d41-ae5a-4549-8fc2-5de7f50afccb None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:28.540184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:28.540836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:28.541113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:28.541380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:28.542283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:28.544287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:28.554054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:28.555025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:28.555848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 450/876] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:28.561865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:28.667698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c1603-3f84-4c79-9c9b-9f1172c117fa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:28.699864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:28.705699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:28.706435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:28.706714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:28.706985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:28.707668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:28.707975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:28.709369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66394e-36bb-442d-a267-04e59d7bde78 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:28.718172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 427/877] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:28.723563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:28.777404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:28.833557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c5eb0-a173-4a15-aff6-2259bdf0ac50 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:28.870621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:28.871228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:28.872026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:28.872388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:28.873190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:28.873489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:28.874851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b35d9-c1ef-4ce5-b577-3b1b7bdd21be None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:28.879646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 451/878] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:29.297759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685705-ac14-4c16-899d-1f39d544ae78 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.298799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685705-ac14-4c16-899d-1f39d544ae78 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.299291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685705-ac14-4c16-899d-1f39d544ae78 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.301327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 428/879] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:29.306840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327586d-d142-462f-9022-ef5213716093 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.307134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327586d-d142-462f-9022-ef5213716093 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.307409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327586d-d142-462f-9022-ef5213716093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.326548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e327586d-d142-462f-9022-ef5213716093 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:29.327725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e327586d-d142-462f-9022-ef5213716093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:29.397913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 452/880] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:29.617969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1fbd3-859c-42d7-bca7-d8366540491f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.618154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1fbd3-859c-42d7-bca7-d8366540491f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.618439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1fbd3-859c-42d7-bca7-d8366540491f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.620037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 429/881] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:29.625640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.625931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.626209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.645211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:29.646416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:29.671404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3f5a-9b19-4178-bef1-89066903bdf2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.671689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3f5a-9b19-4178-bef1-89066903bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.671964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3f5a-9b19-4178-bef1-89066903bdf2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.673590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 430/882] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:29.678511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.678802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.679079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.689917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:29.698991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:29.700293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:29.720976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 453/883] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:29.725126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:29.779646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 431/884] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:29.837677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a809e1a-a185-4b70-a615-f6666a297cec None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:29.873266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:29.874195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:29.874667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:29.875149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:29.875995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:29.877573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:29.894986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 454/885] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:29 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:30.012526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.057122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.097294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.135248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b194a-a68f-4e69-8862-b22bedc4f5fb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.172145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.182543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218859-e35e-4bc4-ab08-b08153987168 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.184778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.185663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.187027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.187503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.188309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.189868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:30.202067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:30.203072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:30.204161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:30.212399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 432/886] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:30.214301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.230351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.232028 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.232532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.232816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.244337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:30.250067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:30.250962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:30.251775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 455/887] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:30.256869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.346118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bca35b-522e-414f-be45-a4cdc569598f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.375187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.386589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967fc8f-4441-42b0-b951-2b3316de0d10 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.395472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.396817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.397378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.397843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.399112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:30.399612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.402852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.414928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 433/888] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:30.415340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.435011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.436626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.437103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.437638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.438605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:30.439100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.440947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.451476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 456/889] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:30.460209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.489065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.540768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baabec1-434e-4087-835b-e4f6a7969ab2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.573125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a128-cc32-4d50-8067-3f43ef430765 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.583923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.584404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.584689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.584969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.585675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:30.585984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.587486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.598675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 434/890] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:30.600593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.619976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.621022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.621642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.622155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.636060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.639563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:30.657041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:30.658042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:30.658920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:30.658920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:30.658920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:30.661036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 457/891] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:30.667162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.672740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.744371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a675-2f9a-46cb-8b23-e11dc78ffddb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.765159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.787656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.788734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.789213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.789747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.790739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] RBAC: Adding query filter params (interface=public, service_id=58e06a07ab4041a9aa6f8a0293454a16, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:30.791395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.792986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.803927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 435/892] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/endpoints?service_id=58e06a07ab4041a9aa6f8a0293454a16&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:30.806581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.821324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750d03-8303-4088-b143-a44bb04aebf8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.872222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.873160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.873860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.875509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.875509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:30.875509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.878677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae097-74e6-421d-91a4-fe83166473fc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.897635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 458/893] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:30.898938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101d527-77a8-43d1-9cbe-fbbe44c8e8ab None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.899230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101d527-77a8-43d1-9cbe-fbbe44c8e8ab None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.899501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101d527-77a8-43d1-9cbe-fbbe44c8e8ab None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.904360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 459/894] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:30.904360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101d527-77a8-43d1-9cbe-fbbe44c8e8ab None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:30.928058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632b97-0c51-4c43-9910-01eebd4efb36 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:30.983062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:30.984775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e429a4a-a3e2-4fcd-bd91-0d2fac8c131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:30.985515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e429a4a-a3e2-4fcd-bd91-0d2fac8c131e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.985955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e429a4a-a3e2-4fcd-bd91-0d2fac8c131e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.986225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e429a4a-a3e2-4fcd-bd91-0d2fac8c131e None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:30.986850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e429a4a-a3e2-4fcd-bd91-0d2fac8c131e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:30.988825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e429a4a-a3e2-4fcd-bd91-0d2fac8c131e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:30.995451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 436/895] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:14:30.996872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:30.997388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:30.997707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:31.036152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:31.037804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:31.049391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101d527-77a8-43d1-9cbe-fbbe44c8e8ab None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:31.115791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:31.132167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:31.134827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:31.135631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:31.136428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:31.150312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:31.151810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:31.156615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 437/896] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:31.172441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:31.173428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:31.174357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:31.176494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 460/897] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:14:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:31.182396 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:31.301497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b14b-6548-4a18-be5a-5491e2fc32ce None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:31.344377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:31.344995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:31.345270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:31.345540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:31.346274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:31.346841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:31.347996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:31.367791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 438/898] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 17 19:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:31.373608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:31.438458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:31.481234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54514f-db46-4c92-a815-9b53de52da05 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:31.481754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:31.513036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:31.521072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:31.522029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:31.522541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:31.523024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:31.562064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708ff4-9081-4221-aa4a-36632ee82124 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:31.596133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:31.597991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:31.601827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:31.602521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:31.602871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:31.603211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:31.603919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:31.605320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:31.624402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 439/899] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:31 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:31.724490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 461/900] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:31 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:14:31.732296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:31.846656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:31.861259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d62d4-9123-4cff-a679-068c867ee795 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:31.897561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:31.898556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:31.899038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:31.899508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:31.911894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:31.913666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ace4125c-71d2-43f4-a8ba-71ca16831f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:31.929588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:31.930558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:31.931439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:31.931439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:31.931439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:31.937967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 440/901] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:31.939511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:31.972623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:32.042942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d9823-38b9-4104-95cc-d4420283ee86 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.043352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d9823-38b9-4104-95cc-d4420283ee86 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.043649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d9823-38b9-4104-95cc-d4420283ee86 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.045735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 441/902] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:32.051144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.051658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.052126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.053565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866a32-9e3a-49b1-97b6-0db5fe3f1e35 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.071670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:32.073364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:32.095962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.097114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.097399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.097684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.098344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:32.098900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.100551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.120413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 462/903] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:32.122883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:32.172569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 442/904] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:32.239760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c177262-8710-4d9e-a024-996c76e38cee None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.241521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:32.275735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.276308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.276592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.276862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.283727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.285192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:32.296934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:32.298135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:32.299410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:32.302799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 463/905] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:32.304171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:32.379806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:32.414532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bbb8a-762f-4883-b019-2f7c7aec3469 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.450718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:32.457597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.458202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.458476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.458744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.459430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:32.459727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.461235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.478505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 443/906] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:32.485121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:32.563659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d29ea1-9122-4b2a-a546-a659fb9d809e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.599958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.600629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.600908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.601179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.601756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.603281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:32.612580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:32.614497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:32.615677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 464/907] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:32.616838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361925e4-85fa-48a0-800f-ce94cb5a464e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.620334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:32.632466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:32.651201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:32.657333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.657952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.658233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.658507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.659390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] RBAC: Adding query filter params (role.id=4b9fb858181b408288f39926aa8f09b6, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=0fabcbac1c744d918621344b3dc8a3ce) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:32.659575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.660972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.672427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 444/908] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/role_assignments?user.id=0fabcbac1c744d918621344b3dc8a3ce&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=4b9fb858181b408288f39926aa8f09b6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:32.744211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a6bb-316f-4303-bcc1-0153889733b9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.783317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.784385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.784883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.785350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.786194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:32.786690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.788298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.795194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 465/909] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:32.801025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:32.912751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a296-c257-4df9-be35-6df2d85723bb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:32.948658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:32.949674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:32.950168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:32.950641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:32.951459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:32.951951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:32.953518 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:32.959218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 445/910] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:32.964875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:33.050152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:33.083294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2ff2-aa62-415a-a199-a77c09514705 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:33.117799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:33.118490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.118764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.119036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.119729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] RBAC: Adding query filter params (interface=public, service_id=34233805dc0b47ff9c5caa031c213dcc, region_id=RegionOne) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:33.120031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:33.121473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d8347-052d-4c74-bb66-e2ec1e0d0d47 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:33.129680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 466/911] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:32 2022] GET /identity/v3/endpoints?service_id=34233805dc0b47ff9c5caa031c213dcc&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:33.134929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:33.199206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:33.244713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8971c24-d9fc-4ca9-b261-b78108896936 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:33.279903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583e86b-b3cb-4977-9839-4fd4c647e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:33.280722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e86b-b3cb-4977-9839-4fd4c647e109 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.281069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e86b-b3cb-4977-9839-4fd4c647e109 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.281341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583e86b-b3cb-4977-9839-4fd4c647e109 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.281950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e86b-b3cb-4977-9839-4fd4c647e109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:33.283352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583e86b-b3cb-4977-9839-4fd4c647e109 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:33.289929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 446/912] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:33 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:14:33.378379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e645c9-53c4-4cc6-98f8-58a458bf790c None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.378379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e645c9-53c4-4cc6-98f8-58a458bf790c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.378379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e645c9-53c4-4cc6-98f8-58a458bf790c None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.379344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 467/913] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:33.385413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4161f5-9e34-4e77-9fbb-bb552e367d3f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.386043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4161f5-9e34-4e77-9fbb-bb552e367d3f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.386043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4161f5-9e34-4e77-9fbb-bb552e367d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.409523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5f4161f5-9e34-4e77-9fbb-bb552e367d3f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:33.410767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5f4161f5-9e34-4e77-9fbb-bb552e367d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:33.493535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 447/914] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:33.659955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec475c-354c-40c5-9d48-d95ab453ff4f None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.660676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec475c-354c-40c5-9d48-d95ab453ff4f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.660676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec475c-354c-40c5-9d48-d95ab453ff4f None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.662053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 468/915] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:33.667351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.667643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.667917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.686927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:33.688165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:33.750534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:33.770549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec475c-354c-40c5-9d48-d95ab453ff4f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:33.774520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 448/916] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:33.881119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec475c-354c-40c5-9d48-d95ab453ff4f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:33.916186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:33.917099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:33.917551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:33.918010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:33.918756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:33.920287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:33.923120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:33.929988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:33.931048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:14:33.932044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:33.934961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 469/917] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:33.940955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.054463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98a0ba-88a2-4c72-a08b-84bd11efa32f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.097506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.098160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.098460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.098739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.099384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:34.099708 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.101166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.106977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 449/918] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:34.112568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.134533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.207679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:34.248964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69fcb-9a29-433b-b84e-89bafc863073 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.274082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bab1f-0644-40aa-ad2f-fd4d7fcbeed7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.293825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.294999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.295471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.295893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.296959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:34.297832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.299357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.311841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 470/919] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 17 19:14:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:34.313868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.321875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.322517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.322801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.323075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.323664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.326304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:34.338930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:34.340011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:34.341001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:34.341783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 450/920] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:34.347047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.394936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:34.446719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a5232-7d1b-442e-bace-707cbb4cd780 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.485855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.486421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ac861-48ae-4e27-9100-faa0df74b81c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.486870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.486870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.487021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.487730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.489338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.502130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:34.524370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 471/921] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:34.553418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.554515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.554988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.555451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.556324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:34.556871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.558555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986285b-3797-4959-bb9a-c58e29034f08 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.566294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 451/922] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:34.572664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.691121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cceae-c077-4612-8c78-907ea23d80ae None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.691405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cceae-c077-4612-8c78-907ea23d80ae None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.691668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cceae-c077-4612-8c78-907ea23d80ae None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.693296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 452/923] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:34.699018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208797f5-e86d-467f-9061-d134086431eb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.699302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208797f5-e86d-467f-9061-d134086431eb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.700121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208797f5-e86d-467f-9061-d134086431eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.702013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0053-8a9d-49fb-bf82-b32bb7b21a60 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.723464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-208797f5-e86d-467f-9061-d134086431eb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:34.724815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-208797f5-e86d-467f-9061-d134086431eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:34.728149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:34.749670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.750291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.750627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.750906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.751540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:34.751844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.753265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.758513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 472/924] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:34.767190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:34.813103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 453/925] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:34.878064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f54ec-26d6-44e1-85a8-0a44356a36d6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:34.915029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:34.915651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:34.915930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:34.916203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:34.916936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] RBAC: Adding query filter params (interface=public, service_id=9adfc2b6d822488485db308ce27762c5, region_id=RegionOne) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:34.917243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:34.918660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:34.924865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 473/926] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:34 2022] GET /identity/v3/endpoints?service_id=9adfc2b6d822488485db308ce27762c5&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:34.930465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208797f5-e86d-467f-9061-d134086431eb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:35.047532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208797f5-e86d-467f-9061-d134086431eb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:35.049107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:35.090794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:35.091697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.091988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.092279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.092897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:35.094272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:35.100566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 454/927] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:34 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:14:35.101561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:35.159962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:35.214551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfab60-8959-41f6-8ab6-aa089daf606f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:35.252412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:35.253054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.253374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.253645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.264832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:35.270043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:35.270999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:35.271984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 474/928] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 17 19:14:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:35.277260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:35.386590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ed7e4-0b91-46da-9c43-b74b8666f6bd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:35.424778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:35.425762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.426307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.426793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.427663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:35.428181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:35.429815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf54306-a985-40dd-b598-e987c12a1b90 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:35.441286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 455/929] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:14:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:35.447108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:35.564608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d738e-452a-41a0-851b-aa67440b0e8e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:35.565985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf09de4-07a5-48fb-96b3-5d8ccffb3b23 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.566949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf09de4-07a5-48fb-96b3-5d8ccffb3b23 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.568299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf09de4-07a5-48fb-96b3-5d8ccffb3b23 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.570165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 456/930] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:35.576494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.577350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.577870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.588544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:35.602403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:35.603610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:35.605461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:35.606147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.606420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.606688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.623213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:35.624928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:35.630326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:35.643126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:35.644100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:35.645022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:35.645022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:35.645022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:35.645022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 475/931] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:35.649800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:35.687586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 457/932] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:35.770811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e43e63-7ff4-46d1-8b4a-8417645b5bee None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:35.806713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:35.807328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.807610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.807884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:35.808560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:35.809252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:35.810637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:35.823427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 476/933] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:35.829582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:35.952133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb2c5d-eac0-46c5-ad59-2c09c5bf19b6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:35.992290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:35.992938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:35.993222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:35.993493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.001982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.003430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:36.016537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:36.018716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:36.020984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 458/934] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:14:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:36.026893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.027088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.048594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.050532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.135220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7c9f-dca7-4bcd-8ef6-faea3b6b2cca None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.145141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0dd5f-b45d-43a5-9359-6eac0980034d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.173252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.174259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.174794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.175239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.176157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:36.176685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.178487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.182998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.183642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.184914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.185417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.186072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.187517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:36.197341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:36.198313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:14:36.199181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:36.207635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 459/936] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:36.207635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.207968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 477/936] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:36.209045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.301488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.315642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.332688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf448-ee5b-46ce-8651-1b576e126813 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.342717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22008346-3a1a-44c0-ba1f-646d7c258df7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.370800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.371966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.372537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.373026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.381373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.382092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.382378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.382650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.383282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:36.383584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.384788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.384967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.386736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.395411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 460/937] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:36.396772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:36.403707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:36.404708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:36.405756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:36.405756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:36.405756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:36.411855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 478/938] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:36.413296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.511150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd922f6-53ec-4afc-b26a-36e3b91a28a2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.520941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e482e9-b63f-4b6d-aba7-4ac13b96a961 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.551264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.551885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.552170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.552477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.553308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.553434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:36.554481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.556928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.561392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.562252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.562702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.563163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.563976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:36.564488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.566015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.568468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 461/939] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:36.570172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.585010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 479/940] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:36.585619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.586987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.681627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae268b6-da67-41ae-829c-32c9d731e8cd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.701334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1841d8-a854-4892-b09b-a09dbb5a016b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.717746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733a507-285e-48e2-8e54-cdd2495af3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.718665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733a507-285e-48e2-8e54-cdd2495af3c4 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.719182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733a507-285e-48e2-8e54-cdd2495af3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.719591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733a507-285e-48e2-8e54-cdd2495af3c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.720433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733a507-285e-48e2-8e54-cdd2495af3c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.722060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733a507-285e-48e2-8e54-cdd2495af3c4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.738272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.739015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.739403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.739721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.748973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 462/941] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:36.748973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c55de-73af-44e8-a5f8-8b7fdf679092 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.748973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c55de-73af-44e8-a5f8-8b7fdf679092 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.748973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c55de-73af-44e8-a5f8-8b7fdf679092 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.748973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 463/942] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:36.753407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb8784-9af4-433a-901b-74261588134a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.753694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb8784-9af4-433a-901b-74261588134a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.755968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb8784-9af4-433a-901b-74261588134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.756094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.756094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:36.770197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:36.771760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:36.772980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 480/943] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:36.778202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:36.782624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4bcb8784-9af4-433a-901b-74261588134a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:36.783909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4bcb8784-9af4-433a-901b-74261588134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:36.839330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.869888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:36.900886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 464/944] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:36.911050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a26f7-b63e-484a-9f52-4a8d1152abcf None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:36.948701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:36.949320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:36.950275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:36.950571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:36.951320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:36.951665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:36.953248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04d4f1-5646-448a-9db6-3f8c02817f27 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:36.966692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 481/945] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:36.973454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb8784-9af4-433a-901b-74261588134a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:37.091537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb8784-9af4-433a-901b-74261588134a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:37.132105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:37.133177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.133684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.135607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920348c2-1c49-4759-959b-5771fe074fb7 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.136052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920348c2-1c49-4759-959b-5771fe074fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.136359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920348c2-1c49-4759-959b-5771fe074fb7 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.138701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 482/946] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:37.138861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/0fabcbac1c744d918621344b3dc8a3ce/roles/4b9fb858181b408288f39926aa8f09b6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.140932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=0fabcbac1c744d918621344b3dc8a3ce, role_id=4b9fb858181b408288f39926aa8f09b6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:37.142374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:37.145090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.145090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.145090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.158463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 465/947] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:36 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/0fabcbac1c744d918621344b3dc8a3ce/roles/4b9fb858181b408288f39926aa8f09b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:14:37.167040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:37.168798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:37.187663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:37.260219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 483/948] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:37.272061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:37.304798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ae4a3-1806-494d-9816-b993d336ff44 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:37.342993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:37.343744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.344166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.344559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.345303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:37.346742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:37.349495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING keystone.server.flask.common [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 19:14:37.368618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.sql.core [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 19:14:37.368618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 19:14:37.368618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [parameters: {'id': '1e9f32fe6e3942919aea4d060289eef4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 19:14:37.368618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81675) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e9f32fe6e3942919aea4d060289eef4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e9f32fe6e3942919aea4d060289eef4. Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:14:37.386546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result.read() Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 19:14:37.388232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application yield resource Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise self.value Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application session.commit() Aug 17 19:14:37.389246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.session.flush() Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application compat.raise_( Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 19:14:37.390341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 19:14:37.392206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application result.read() Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:14:37.393942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [parameters: {'id': '1e9f32fe6e3942919aea4d060289eef4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.395685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:37.396824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e9f32fe6e3942919aea4d060289eef4. Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.399573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 466/949] 10.222.0.62 () {60 vars in 1140 bytes} [Wed Aug 17 19:14:37 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:37.400378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:37.444496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:37.507649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b89c5a-ecdb-4212-afa5-78669b91caa0 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:37.543715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:37.544684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.545165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.545625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.552748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:37.554377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:37.566388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:37.567285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:37.568142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:37.570245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 484/950] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:37.570555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:37.578381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:37.707356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a534-7239-41ba-931e-ce9e1ad75ce5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:37.719786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:37.724720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:37.729433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ffaee-e172-4d27-aab6-3e92404948d8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:37.753148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:37.753795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.754118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.754400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.754985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:37.757025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:37.768526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:37.769580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:37.770418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 467/951] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:37.778345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:37.783386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:37.783978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.784285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.784565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.785235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:37.785537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:37.786969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:37.809838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 485/952] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:37.897250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ddd36-b5ca-46cd-831f-fb84d05ca3a4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:37.948128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:37.950286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:37.951106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:37.951911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:37.953363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:37.954209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:37.956211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:37.970932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 468/953] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:37.979261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:38.104628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89e94-0803-4cd0-8867-2618fc683458 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:38.141586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:38.142548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:38.143027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:38.143515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:38.144383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:38.144885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:38.146467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59735e7-3321-42c9-bf41-ec683cde3555 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:38.152261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 486/954] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:38.160266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:38.201003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:38.274430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6204cb-475b-4c2a-9c0b-c9d80a629613 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:38.312718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d7463-575c-4f19-8abd-b24fab7663cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:38.313336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d7463-575c-4f19-8abd-b24fab7663cf None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:38.313621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d7463-575c-4f19-8abd-b24fab7663cf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:38.313899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d7463-575c-4f19-8abd-b24fab7663cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:38.314573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d7463-575c-4f19-8abd-b24fab7663cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:38.315998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d7463-575c-4f19-8abd-b24fab7663cf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:38.341774 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 469/955] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:38.889942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f13485-8696-4649-a311-0afdccb7de25 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:38.890975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f13485-8696-4649-a311-0afdccb7de25 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:38.891462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f13485-8696-4649-a311-0afdccb7de25 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:38.893294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 487/956] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:38.898789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbb94-9ffc-45bc-b8a0-a9e12733c719 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:38.899612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbb94-9ffc-45bc-b8a0-a9e12733c719 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:38.900104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbb94-9ffc-45bc-b8a0-a9e12733c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:38.920637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a2cbbb94-9ffc-45bc-b8a0-a9e12733c719 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:38.922219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a2cbbb94-9ffc-45bc-b8a0-a9e12733c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:39.006212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 470/957] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:39.120722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00161de-8478-45fd-88a1-f3e2481fb4b9 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.121486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00161de-8478-45fd-88a1-f3e2481fb4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.122205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00161de-8478-45fd-88a1-f3e2481fb4b9 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.125096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 488/958] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:39.130354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.130682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.130982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.150110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:39.151206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:39.165219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:39.226198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 471/959] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:39.294375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00161de-8478-45fd-88a1-f3e2481fb4b9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:39.328285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:39.409568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00161de-8478-45fd-88a1-f3e2481fb4b9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:39.446344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:39.446976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.447250 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.447516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.448155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:39.450210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:39.459753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:39.460891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:39.462194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 489/960] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:39.467373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:39.500609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:39.580734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b5195-b4dd-4779-a8f9-444b88809ceb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:39.651661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:39.656410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:39.657993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.657993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.657993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.658485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:39.658704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:39.660896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:39.667240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 472/961] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:39.677329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:39.678749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9fed-df6e-4079-b782-84417765ca62 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:39.721509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:39.723558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:39.724383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.724830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.725587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.748607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:39.760514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:39.761515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:39.762434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:39.773263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 490/962] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 17 19:14:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:39.774334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:39.896022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db5d4a-572d-467e-b3ae-bc6a8d008d11 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:39.933074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:39.933716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.933963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.934236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.934872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:39.935176 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:39.936582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930437a-d1bd-4dad-963b-5ef7011796b6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:39.941451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 473/963] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:39.942771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082d51-f916-4d6c-bd40-4a88809932c1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.943043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082d51-f916-4d6c-bd40-4a88809932c1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.943319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082d51-f916-4d6c-bd40-4a88809932c1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.944918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 474/964] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:39.955377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:39.955680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:39.955956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:39.981829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4065c-cd33-427e-bb66-7aa6f1e3dc08 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:39.987264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:39.988523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:40.050848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.051982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.053332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.053859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.054762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:40.055870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.058364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.095201 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 491/965] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:14:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:40.096527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.100565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 475/966] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:40.121013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:40.219676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac3c94-12f1-4deb-8f54-602dd334be71 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.255324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.255966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.256264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.256545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.268039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.269511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:40.284679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:40.285671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:40.287166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:40.287166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:40.287166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:40.287166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 492/967] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:40.291661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.300530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:40.374968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.401628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cc87-3bcd-42a4-aad8-5add4a692bdb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.449003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.450484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.450757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.451030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.452105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:40.452439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.454319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b12e-fce6-4045-be4f-0ac054b6d06b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.455126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:40.473696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 476/968] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:40.475470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527cbe3-f072-4203-907d-b11bdc9ca29b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.475760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527cbe3-f072-4203-907d-b11bdc9ca29b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.476035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527cbe3-f072-4203-907d-b11bdc9ca29b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.478378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 477/969] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:40.479108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527cbe3-f072-4203-907d-b11bdc9ca29b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.502247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae5d44-149c-46a5-9335-a22ccb5e16e9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.538072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.538685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.538966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.539240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.539880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.541350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.544410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING keystone.server.flask.common [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 19:14:40.555282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:40.558150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.sql.core [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 19:14:40.558150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 19:14:40.558150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [parameters: {'user_id': 'a89c7a7b3e2047079ba504c93405ead6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 19:14:40.558150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81674) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-083a186d-1642-4617-a1dd-3b2e9fd3dfa6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result.read() Aug 17 19:14:40.565441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:14:40.566344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application yield resource Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise self.value Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application session.commit() Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 19:14:40.568235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.session.flush() Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application compat.raise_( Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 19:14:40.569370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:14:40.570335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application result.read() Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:14:40.572145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a89c7a7b3e2047079ba504c93405ead6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:40.573606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 19:14:40.576079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 493/970] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 17 19:14:40 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.578441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.592991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:40.594634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:40.599965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527cbe3-f072-4203-907d-b11bdc9ca29b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.635264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.635942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.636222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.636516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.645009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.646439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:40.658173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:40.659295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 478/971] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:40.660470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.675078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 494/972] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:40.676098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.734661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:40.778364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f8a74-afe5-43bc-8381-30b7d3153377 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.781825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cbf44-a185-4d85-a324-7b374c8b4063 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.805960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:40.816882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.817099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:40.817859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.817977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:40.818262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.818542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:40.818651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.819053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:40.819928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:40.820396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.822170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.827761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:40.829651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:40.842164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:40.843345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:14:40.844530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:40.845875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 479/973] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:40.848648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 495/974] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:40.850959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.854193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:40.964001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb22cd-f8c5-4ce9-8608-4c3b6e386c7f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.978474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f54a-0120-46b1-9a72-465439af6c99 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:40.985162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.013061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.013898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.014272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.014609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.018536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.019152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.019495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.019778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.020508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:41.020813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.022370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.068280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 480/975] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:41.068280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.100483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.102189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.124843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.216188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772655fe-3fba-49a6-8e05-16f4b80c7ea8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.227678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 496/976] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 19:14:41.235008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.255022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.263503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.264131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.264442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.264712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.265287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.266638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:41.281038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:41.282244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:41.283084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 481/977] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:41.287509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.364521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f5231-ff8b-4771-97a2-833982b1d46c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.405050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.405849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.406125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.406395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.418068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.419560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.420477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebceda-4e73-4702-adb8-3a08c58e460f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.430660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:41.435974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:41.437179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:41.438278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:41.438278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:41.438278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:41.441665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 497/978] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:41.442558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.462931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.463545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.463836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.464096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.464751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:41.465108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.466675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.471520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 482/979] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:41.477078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.510939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.553227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad371d-d11d-4ecb-9ac8-0347cf95f8b9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.586725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e9ad-ff9f-4653-baf9-c0dc114de94f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.590622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.591467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.591955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.592449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.593297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:41.593791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.595393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.608786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 498/980] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:41.614178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.623275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.623891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.624212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.624527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.625150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:41.625472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.626826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.632418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 483/981] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:41.638892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.680094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.726540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40f72-c73d-4d12-abcf-8721d258d7d7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.751621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624e76-0624-4592-9d89-a3797742f775 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.752424 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.765761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.766325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.766600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.766866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.774093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.775649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:41.787676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:41.788731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:41.789677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 499/982] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:41.794979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.795440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.795606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.795858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.796126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.796867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] RBAC: Adding query filter params (interface=admin, service_id=9adfc2b6d822488485db308ce27762c5, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:41.797171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.798520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.808712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 484/983] 10.222.0.62 () {56 vars in 1249 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/endpoints?service_id=9adfc2b6d822488485db308ce27762c5&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:41.809883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.904636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde55ce-b5da-45cb-83a3-927b337b56d9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.913569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:41.916899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b38000-ce98-41d2-ae80-f8472c40483e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:41.944682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.945293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.945578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.945852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.946538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:41.946846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.948295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.951876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f14e-276b-41bf-af37-5472786f9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:41.952508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f14e-276b-41bf-af37-5472786f9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.952787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f14e-276b-41bf-af37-5472786f9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.953056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f14e-276b-41bf-af37-5472786f9cf4 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.953648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f14e-276b-41bf-af37-5472786f9cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:41.955245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f14e-276b-41bf-af37-5472786f9cf4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:41.961054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 485/984] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:14:41.966754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 500/985] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:41.966944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00753d9-4801-4074-a128-f54d55d5cb20 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.966944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00753d9-4801-4074-a128-f54d55d5cb20 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.966944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00753d9-4801-4074-a128-f54d55d5cb20 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:41.966944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 486/986] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:41.968573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:41.974454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:41.974791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:41.975026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:42.000669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:42.002722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:42.030554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:42.083026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 487/987] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:42.097348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae946-c077-4c8c-9db9-f72a6bc6095f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:42.134871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:42.135484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:42.135763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:42.136035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:42.137418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] RBAC: Adding query filter params (role.id=4b9fb858181b408288f39926aa8f09b6, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=0fabcbac1c744d918621344b3dc8a3ce) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:42.137729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:42.139153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f54a76-b9e1-4600-8eca-c7e5144e27f3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:42.145421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 501/988] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:41 2022] GET /identity/v3/role_assignments?user.id=0fabcbac1c744d918621344b3dc8a3ce&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=4b9fb858181b408288f39926aa8f09b6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:42.363633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:42.462596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:42.470134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90ad95-b085-4eb0-8ea7-af8d59333920 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:42.505093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea2561-eb54-4b2d-b87a-1cc28d9a4fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:42.505705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea2561-eb54-4b2d-b87a-1cc28d9a4fed None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:42.505982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea2561-eb54-4b2d-b87a-1cc28d9a4fed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:42.506256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea2561-eb54-4b2d-b87a-1cc28d9a4fed None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:42.506899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea2561-eb54-4b2d-b87a-1cc28d9a4fed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:42.508267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea2561-eb54-4b2d-b87a-1cc28d9a4fed None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:42.528347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 488/989] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:42 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:43.889489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916342a-b8cf-46cf-a778-23d7f58ff9c7 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:43.890011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916342a-b8cf-46cf-a778-23d7f58ff9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:43.890200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916342a-b8cf-46cf-a778-23d7f58ff9c7 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:43.891515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 502/990] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:43.896637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4183c-daee-4a5c-8053-dc81313d88e7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:43.897013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4183c-daee-4a5c-8053-dc81313d88e7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:43.897182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4183c-daee-4a5c-8053-dc81313d88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:43.915282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d5a4183c-daee-4a5c-8053-dc81313d88e7 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:43.916477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5a4183c-daee-4a5c-8053-dc81313d88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:43.998166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 489/991] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:44.100931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1d54-ca4c-44aa-b128-9200f7b8c9a4 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.101295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1d54-ca4c-44aa-b128-9200f7b8c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.101497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1d54-ca4c-44aa-b128-9200f7b8c9a4 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.102993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 503/992] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:44.108722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.109015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.109296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.128370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:44.129559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:44.197050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 490/993] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:44.265215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe1d54-ca4c-44aa-b128-9200f7b8c9a4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.370463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe1d54-ca4c-44aa-b128-9200f7b8c9a4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.380725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:44.406408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.407039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.407313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.407579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.408152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.409534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-4f65a318-1596-4258-81b5-5aa76215c0a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:44.418218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:44.419380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 19:14:44.420286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:44.421677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 504/994] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:44.425423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.428695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e48f3-43d3-4691-bc75-7d9474fd9ce9 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.428979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e48f3-43d3-4691-bc75-7d9474fd9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.429248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e48f3-43d3-4691-bc75-7d9474fd9ce9 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.430705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 505/995] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:44.435831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.436112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.436412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.438581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:44.456831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:44.458147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:44.524913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 506/996] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:44.525744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.533986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fbba8-33ec-43c7-8759-368bfc370736 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.571341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.571952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.572230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.572528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.573153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:44.573459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.575555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:44.581210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 491/997] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:44.587126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.629121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e55d0-d55a-4777-af15-ebcdf8e401b8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.630847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:44.665006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.665631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.665910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.666174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] PATH_INFO: `/v3/services/image` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.666743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.668128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:44.670870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:44.677380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:44.678373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:44.679220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 507/998] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:44.686827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.701911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db9ed-981e-45e8-85ff-6e28540f5d4a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.736514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.737043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.737321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.737592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.738212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:44.738510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.739853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:44.745067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 492/999] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:44.751286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.793497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ba47-e819-4a32-88c0-c9e4b46a884b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.831772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.832420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.832704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.832976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.833604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:44.833907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.835273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:44.840095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 508/1000] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:44.840984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.861089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884a0fd-6f1e-45ed-8df0-b7bc60baf82a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.871095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:44.895486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.896096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.896407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.896689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.897349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.898712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:44.909863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:44.932275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 493/1001] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:44.932275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:44.944799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99389b-bf18-4c42-89f6-e419515739b5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:44.994542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:44.995105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:44.995390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:44.995891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:44.996859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:44.998470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:45.008604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:45.009593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:45.010512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 509/1002] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:45.016104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:45.048403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8fb2-9899-46f3-bde5-732450ff7b8c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:45.086830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:45.087471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:45.087750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:45.088024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:45.088686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] RBAC: Adding query filter params (type=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:45.088990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:45.091216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:45.096317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 494/1003] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:45.125813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:45.138134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac056ee-43fb-4ea0-85f4-eb7bb762c2bc None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:45.179724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:45.180270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:45.180571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:45.180810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:45.181444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:45.181868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:45.183121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:45.190905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 510/1004] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:45.197349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:45.267773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:45.309314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ee30c-11cf-45c0-8341-e5d8da6779be None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:45.344014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:45.344661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:45.344937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:45.345206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:45.345825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:45.346121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:45.347470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:45.357838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 495/1005] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:45.359111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:45.466624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351dae-a342-4ecc-aa8c-ea687667e847 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:45.499887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:45.500515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:45.500795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:45.501061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:45.501752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] RBAC: Adding query filter params (interface=public, service_id=5a6e43c69e704667a9868461154e3073, region_id=RegionOne) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:45.502056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:45.503409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6558c4-466b-42da-adf5-dba9be5dde57 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:45.508733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 511/1006] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:45 2022] GET /identity/v3/endpoints?service_id=5a6e43c69e704667a9868461154e3073&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:45.514580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:45.618953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec36b-7ffe-4f10-a542-d2d0e251b75b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:45.644959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:45.654574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cfa48-9add-4f70-8f36-9b7092eeeb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:45.655178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cfa48-9add-4f70-8f36-9b7092eeeb5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:45.655454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cfa48-9add-4f70-8f36-9b7092eeeb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:45.655724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cfa48-9add-4f70-8f36-9b7092eeeb5c None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:45.656341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cfa48-9add-4f70-8f36-9b7092eeeb5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:45.657689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cfa48-9add-4f70-8f36-9b7092eeeb5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:45.670654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 496/1007] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:45 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:14:46.908843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b8fa4-9d06-411e-b5bd-5d8f6f4482f3 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:46.909354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b8fa4-9d06-411e-b5bd-5d8f6f4482f3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:46.909431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b8fa4-9d06-411e-b5bd-5d8f6f4482f3 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:46.910889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 512/1008] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:46.915816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5296-4ad7-473d-a5a4-3e1a551c7a0a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:46.916197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5296-4ad7-473d-a5a4-3e1a551c7a0a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:46.916411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce5296-4ad7-473d-a5a4-3e1a551c7a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:46.936020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-07ce5296-4ad7-473d-a5a4-3e1a551c7a0a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:46.937236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-07ce5296-4ad7-473d-a5a4-3e1a551c7a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:47.013008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 497/1009] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:46 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:47.056542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4866a-d76f-4648-95ca-61c9840ecccf None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.056901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4866a-d76f-4648-95ca-61c9840ecccf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.057240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4866a-d76f-4648-95ca-61c9840ecccf None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.059356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 513/1010] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:47.064587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.064882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.065165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.083460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:47.084710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:47.153919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 498/1011] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:47.288643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4866a-d76f-4648-95ca-61c9840ecccf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:47.309402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:47.394400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4866a-d76f-4648-95ca-61c9840ecccf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:47.427722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:47.432795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:47.433961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.434270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.434524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.435644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:47.437185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:47.438777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 514/1012] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:47.444323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:47.493794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:47.536676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:47.553189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beffba-a976-48f5-ba1f-74154c072d4b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:47.554143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc5e2-4735-41f7-b77f-eec770b55e10 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:47.590382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:47.591007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.591253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a414-9374-4b17-bc1d-1e8d386b22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:47.591387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.591542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.591863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a414-9374-4b17-bc1d-1e8d386b22aa None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.592147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a414-9374-4b17-bc1d-1e8d386b22aa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.592274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:47.592455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a414-9374-4b17-bc1d-1e8d386b22aa None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.593098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a414-9374-4b17-bc1d-1e8d386b22aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:47.593619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:47.594445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a414-9374-4b17-bc1d-1e8d386b22aa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:47.609414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 499/1013] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:47 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:47.610636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47dff1-ca38-4c88-b530-0c1a903013d6 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.610916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47dff1-ca38-4c88-b530-0c1a903013d6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.611184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47dff1-ca38-4c88-b530-0c1a903013d6 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.612591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 500/1014] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:47.622724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:47.623010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:47.623286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:47.627334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 515/1015] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:14:47 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:47.650145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:47.651515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:47.740284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 501/1016] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:47 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:48.018036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:48.120782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6558-0a93-4d10-8eab-07309ffbc4d8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:48.158358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:48.159379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:48.159884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:48.160430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:48.161214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:48.162816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:48.172928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:48.173958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:48.174789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 516/1017] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:48.180785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:48.217892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:48.286560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61750-09fa-4c04-87a4-53ae1d36e986 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:48.320648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:48.321262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:48.321542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:48.321817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:48.322447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:48.322752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:48.324138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:48.334000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 502/1018] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:48.335240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:48.338184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:48.442821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240d924-48cf-4f4d-be70-a3133dfde5b4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:48.477498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:48.478108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:48.478389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:48.478662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:48.479285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:48.479638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:48.481591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110db180-516e-4f54-be97-e252dc3ee7b2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:48.491472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 517/1019] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 17 19:14:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:48.492727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:48.597691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:48.600969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b19ca-5503-48c2-b869-632aa94000c6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:48.637764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe7283-b6c3-400a-9052-0e0a3001298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:48.638499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe7283-b6c3-400a-9052-0e0a3001298e None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:48.638782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe7283-b6c3-400a-9052-0e0a3001298e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:48.639062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe7283-b6c3-400a-9052-0e0a3001298e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:48.639725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe7283-b6c3-400a-9052-0e0a3001298e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:48.641112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe7283-b6c3-400a-9052-0e0a3001298e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:48.664275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 503/1020] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:49.612361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a267c0-ffa9-44b4-bb91-0f82547026f8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:49.613004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca25a-ff94-4d78-bb67-1583c7e3ce34 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:49.613340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a267c0-ffa9-44b4-bb91-0f82547026f8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:49.613415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca25a-ff94-4d78-bb67-1583c7e3ce34 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:49.613484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a267c0-ffa9-44b4-bb91-0f82547026f8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:49.613571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca25a-ff94-4d78-bb67-1583c7e3ce34 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:49.614274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 504/1021] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:49.614704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 518/1022] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:49.619166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:49.619448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:49.619719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155261-dae2-4303-a968-4e33169651bb None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:49.619820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:49.620045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155261-dae2-4303-a968-4e33169651bb None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:49.620366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8155261-dae2-4303-a968-4e33169651bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:49.638490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:49.639665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:49.639871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f8155261-dae2-4303-a968-4e33169651bb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:49.641153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f8155261-dae2-4303-a968-4e33169651bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:49.709973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:49.724207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 505/1023] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:49.728346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 519/1024] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:49.989312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.029253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155261-dae2-4303-a968-4e33169651bb None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.078334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:50.100201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315a07-0873-4006-bce9-c05cea21f89f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.133974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8155261-dae2-4303-a968-4e33169651bb None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.146377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.147919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.149090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.150501 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.153698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.155738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.158673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 506/1025] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:50.167148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.173558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.174200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.174474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.174743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] PATH_INFO: `/v3/services/image` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.175323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.176735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:50.185979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:50.186979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:50.187812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 520/1026] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Aug 17 19:14:50 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:50.192935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.253423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:50.282279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524034c-fec4-466f-a602-5106b2d7c8fb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.302240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a4bb7-7e45-4f91-80f6-443d53ed4b4b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.316315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.316932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.317218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.317490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.318163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.319580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.342088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.342702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.342980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.343242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.352272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] RBAC: Adding query filter params (name=image) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:50.352473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 507/1027] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:14:50 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:14:50.352603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.352603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.352603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 521/1028] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:50.357067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.367752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:50.468664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1793c6-868e-47a8-bfa3-5a779596a02c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.511330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.512887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.513313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.513731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.514719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] RBAC: Adding query filter params (type=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:50.515188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.517380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ed14a-7508-4ef6-aa23-be8ca0059d9a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.525367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 508/1029] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:50.531898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.653199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236da0b-a43a-486c-b2e3-663b67de4c36 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.673594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:50.682587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee44fa-8d2f-44b0-b8b9-6c05d1ffc019 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.683062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee44fa-8d2f-44b0-b8b9-6c05d1ffc019 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.683138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee44fa-8d2f-44b0-b8b9-6c05d1ffc019 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.685338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 509/1030] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:50.690125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.690749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.691024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.691188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.691283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.691730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.691989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] RBAC: Adding query filter params (interface=public, service_id=3bcb314900c749799355ef13d4a9e820, region_id=RegionOne) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:50.692323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.692568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.693702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.698862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 522/1031] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:14:50 2022] GET /identity/v3/endpoints?service_id=3bcb314900c749799355ef13d4a9e820&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:50.705602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:50.712231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:50.713440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:50.780543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:50.786636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 510/1032] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:50.814317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b2d0-ba39-47bb-8083-08b846eaa0f2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:50.847595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:50.848204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:50.848512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:50.848785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:50.849390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:50.850742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:50.858058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 523/1033] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:14:50 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:14:51.075216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:51.177164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a37f5-8568-40ae-8b99-bc52764032f0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:51.213108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:51.213742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:51.214024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:51.214300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:51.224692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:51.229397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:51.230703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:51.231714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 511/1034] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 17 19:14:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:51.236795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:51.291905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:51.347647 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1162421-04cb-47f5-8793-676bfd68a9b7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:51.380575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:51.381184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:51.381461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:51.381738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:51.382404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:51.382710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:51.384063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:51.392034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 524/1035] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:14:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:51.398678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:51.460300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:51.502604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418f53-6225-463c-841e-5750196c0d8f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:51.537314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:51.537947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:51.538226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:51.538498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:51.548666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:51.550132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:51.566089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:51.567109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:51.573080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:51.573080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:51.573080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:51.573080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 512/1036] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:51.576142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:51.684645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd101a-8650-451d-8035-823ce44cc0db None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:51.694594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:51.721479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:51.722324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:51.722752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:51.723169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:51.724017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:51.724566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:51.726131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:51.743126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 525/1037] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:51.744768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:51.848995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7679c-5195-42d1-b237-8307631e4c23 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:51.862570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:51.885460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:51.886096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:51.886379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:51.887243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:51.895752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:51.897215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:51.909287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:51.910247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:51.911302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:51.915159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 513/1038] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:14:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:51.916441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:52.035628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800d7a1-3b10-4fbb-b344-47b29d488a69 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:52.071158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:52.071782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.072056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.072361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.073091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:52.073397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:52.075937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:52.094049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 526/1039] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:14:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:52.099549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:52.201739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a022-0c64-43cc-8cb3-99319410b603 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:52.235596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a8d15-5411-4a83-96af-ce9334c89488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:52.236207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a8d15-5411-4a83-96af-ce9334c89488 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.236515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a8d15-5411-4a83-96af-ce9334c89488 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.236775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a8d15-5411-4a83-96af-ce9334c89488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.277882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:52.305716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a8d15-5411-4a83-96af-ce9334c89488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:52.307258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a8d15-5411-4a83-96af-ce9334c89488 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:52.417285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 514/1040] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:14:52.419889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:52.450588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:52.473535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceb7da-08d7-45c4-9ff4-d57930045d6d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.473865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceb7da-08d7-45c4-9ff4-d57930045d6d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.474166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceb7da-08d7-45c4-9ff4-d57930045d6d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.475788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 515/1041] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:52.481737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.482046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.482363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.502045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:52.503375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:52.530632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ca6f3-d1eb-4b86-b194-971dd32578a4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:52.566855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:52.567485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.567764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.568040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.578468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:52.580158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:52.588394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 516/1042] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:52.595020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:52.595936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:52.596830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:52.596830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:52.596830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:52.600507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 527/1043] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:52.601834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:52.604399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:52.705160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267061ba-3be3-440a-9099-3acdc5a13b39 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:52.739387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:52.739990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.740302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.740577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.741207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:52.741504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:52.742845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf5d67-feeb-4457-b210-569910cbe9fb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:52.759083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 517/1044] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:52.761238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:52.806082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc1ac2-8049-41d9-85d7-8961d3297f14 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.806559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc1ac2-8049-41d9-85d7-8961d3297f14 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.806844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc1ac2-8049-41d9-85d7-8961d3297f14 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.809137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 518/1045] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:52.816669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.817166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.817615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.842426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:52.844416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:52.849649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:52.869643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9f026-7480-4d34-bbee-82a90a7782d2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:52.904100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:52.904754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:52.905029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:52.905298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:52.905623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:52.911968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:52.913417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:52.916652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 519/1046] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:52.917463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:52.925272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:52.926181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:52.927055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 528/1047] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:52.932057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.036232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bbd1-d31c-4a41-baee-2dc1b6cc8d34 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.039779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e4f95-4e91-4782-badb-cfeb73d1d881 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.072105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.072694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.072975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.073248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.080198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.081175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.081780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.082119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.082828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:53.083135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.084505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:53.084612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:53.089232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:53.090704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:53.091544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 520/1048] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:53.094969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.097910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.098514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 529/1049] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:53.105154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.155163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.203551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166cd71-56db-41fb-933e-41ffc3b53314 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.213713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996780-bfc3-4f96-a4dc-17c67894213e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.237714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.238327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.238605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.238876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.239534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:53.239837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.241231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.249320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.249866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 521/1050] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:53.250018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.250191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.250459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.250640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.251184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] RBAC: Adding query filter params (role.id=4b9fb858181b408288f39926aa8f09b6, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=880e3ed0ab1641a3bdab9ff349d09286) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:53.251493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.252961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.258570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 530/1051] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/role_assignments?user.id=880e3ed0ab1641a3bdab9ff349d09286&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=4b9fb858181b408288f39926aa8f09b6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:53.259345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.338088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.380027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6082fd-9f6a-4bd1-821e-1574e7a7d7e5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.386493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8774f-ac35-4e0c-a185-1e61ff8515a7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.396176 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.421239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.421875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.422162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.422424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] PATH_INFO: `/v3/services/image` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.423098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.424381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:53.433206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:53.434370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:14:53.435542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:53.438083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.438794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.439478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] PATH_INFO: `/v3/users/8ddd0063417e47b1951ef74eb0aca79c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.444298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 522/1052] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:53.445894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.458972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] RBAC: Authorizing `identity:get_user(user_id=8ddd0063417e47b1951ef74eb0aca79c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.460546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.467658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 531/1053] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/users/8ddd0063417e47b1951ef74eb0aca79c => generated 285 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:53.468607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.566083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c95b-66cd-4b3a-af95-e725323d2f06 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.575049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdabe9-e21a-4a11-a67a-faeb47b27b65 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.599203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.604816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.605990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.606271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.606544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.607169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:53.607474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.608863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.613258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.614127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.614237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 523/1054] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:53.614407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.614774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.620045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.678776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.704972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.706941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.749680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7e34-6d31-46e9-a46d-cef59a43f6c5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.787634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.788307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.788643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.788826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.789968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] RBAC: Adding query filter params (type=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:53.789968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.791095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.797290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 524/1055] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:53.802681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.823415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 532/1056] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 19:14:53.830753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:53.854805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.916787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ff586-77b8-4644-a827-2f3a74c8a524 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.923803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:53.943161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ce89b-c18c-43cf-af3f-6905f05ba449 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:53.954714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.955410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.955600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.955850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.956571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.957873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.981973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7137b-dba3-4a07-b255-5dbf1e7a79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:53.992502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 525/1057] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:14:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:14:53.992710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7137b-dba3-4a07-b255-5dbf1e7a79b2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:53.992710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7137b-dba3-4a07-b255-5dbf1e7a79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:53.992710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7137b-dba3-4a07-b255-5dbf1e7a79b2 None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:53.992710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7137b-dba3-4a07-b255-5dbf1e7a79b2 None admin] RBAC: Authorizing `identity:get_project(project_id=94b289279d4243ff9a21cc137d3ae019)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:53.992710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7137b-dba3-4a07-b255-5dbf1e7a79b2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:53.992710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 533/1058] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:53.993816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:54.118524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4141d4-b7de-4a53-9915-d58b6e083072 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:54.157606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:54.158226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:54.158509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:54.158783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:54.159518 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=94b289279d4243ff9a21cc137d3ae019, user.id=8ddd0063417e47b1951ef74eb0aca79c) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:54.159832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:54.161369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1235ce-ef61-4d85-bc30-86f5dcd5a479 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:54.167243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 526/1059] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:14:53 2022] GET /identity/v3/role_assignments?user.id=8ddd0063417e47b1951ef74eb0aca79c&scope.project.id=94b289279d4243ff9a21cc137d3ae019&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:55.177868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e8d83-6436-48af-95af-0edca1dd98d5 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:55.178418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e8d83-6436-48af-95af-0edca1dd98d5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:55.178418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e8d83-6436-48af-95af-0edca1dd98d5 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:55.179905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 534/1060] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:55.186316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:55.186737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:55.186904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:55.206155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:55.207358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:55.224431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:55.279549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 527/1061] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:55.556829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e8d83-6436-48af-95af-0edca1dd98d5 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:55.652620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:55.664221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e8d83-6436-48af-95af-0edca1dd98d5 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:55.699990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:55.700662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:55.700946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:55.701221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:55.711672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:55.717602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:55.718512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:14:55.719338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:55.723649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 535/1062] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 17 19:14:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:55.724771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:55.838065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e93592-298c-4ee3-9c9b-896008957450 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:55.874497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:55.875109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:55.875389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:55.875662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:55.876345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:55.876649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:55.878007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fa23-d394-4814-9c95-653ba74ddab6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:55.892927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 528/1063] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:14:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:55.894541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:55.946971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e995-6356-4800-8ba6-3172f039c064 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:55.947278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e995-6356-4800-8ba6-3172f039c064 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:55.947530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e995-6356-4800-8ba6-3172f039c064 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:55.949152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 529/1064] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:55.953757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:55.954299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:55.954568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:55.972599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:55.973770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:55.987076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.006590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd5be5-145e-4132-b32a-c089890b3676 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.045819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.046458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.046738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.047009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.052084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 530/1065] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:56.057818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.059341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f5805010-081f-4e7a-96d0-4e01b4cfb466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:56.074438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:56.075405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:56.076719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:56.076719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:56.076719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:56.080687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 536/1066] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:14:56.081664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.132823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35835e7-8c8b-40d2-b82e-a5307243eb13 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.133036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35835e7-8c8b-40d2-b82e-a5307243eb13 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.133310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35835e7-8c8b-40d2-b82e-a5307243eb13 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.134663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 537/1067] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:14:56.140078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.140398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.140680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.146927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.162182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:56.163371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:56.190246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6c16d-d3ec-455a-8e44-d5e3c8ad97f9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.227763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.228404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.228685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.228951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.229589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:56.229889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.231460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.240303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 538/1068] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:14:56.249642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 531/1069] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:56.255172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.315049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.319560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.357792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b627b-848e-44d2-ad7f-07387985eda1 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.387335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.394139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.394973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.395257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.396421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.405385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.407459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:14:56.421396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:56.422505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:14:56.423665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:56.425555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 539/1070] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:56.431499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.432074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475e0a-38d5-4671-8c4d-a075310624f2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.469258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.469868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.470152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.470425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.536526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b052d6-1a3d-4dad-ab73-9ab48bcfa115 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.538809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.540287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.543419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.570034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.570638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.570915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.571182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.571899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:56.572201 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.573631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.591542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 540/1071] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:56.592378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.642267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.643690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 532/1072] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 19:14:56.644525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.691731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3327-c2c8-4c4d-b4a2-eb0cc691c260 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.726346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.726973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.727253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.727528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.737723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:56.740391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a74dc-1e0d-4749-ae90-abbbcdef7072 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:56.742411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:56.743497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 541/1073] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:56.744389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.746314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.778690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.779322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.779598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.779868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.789724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.791151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:56.805797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:56.806770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:56.807661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:56.807661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:56.807661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:56.807661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 533/1074] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:56.807661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.851175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e49e76-8929-4bcb-896c-e4d46f3caec5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.862444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:56.887701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.888565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.889617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.889911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.901412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.902828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.912815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04340-6ae7-4420-9f9e-31530b91e45e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:14:56.918040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:56.919091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:14:56.919975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:14:56.919975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:14:56.919975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:56.919975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 542/1075] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:56.919975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.948979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:56.949755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:56.950040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:56.950308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:56.950962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:56.951485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:56.952627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:56.961218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 534/1076] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:56.961998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:56.981307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:57.023592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b52d39-13b4-49ad-a79c-082a0ddc79fa None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.057794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.059167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.059536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.059810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.060473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:57.060781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.062153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.065058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206f6e6-9f22-44bd-9187-106059a05fda None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.074685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 543/1077] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:57.075486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:57.099323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.099538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:57.099934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.100348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.100521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.101205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:57.101561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.102911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.114522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 535/1078] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:57.115330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:57.184347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc53aa8-9277-48ee-a3a6-3403139112ae None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.208182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:57.222633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918b586-096a-4203-9a04-cc28364351de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.223293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918b586-096a-4203-9a04-cc28364351de None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.223569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918b586-096a-4203-9a04-cc28364351de None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.223838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918b586-096a-4203-9a04-cc28364351de None admin] PATH_INFO: `/v3/users/8ddd0063417e47b1951ef74eb0aca79c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.225056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918b586-096a-4203-9a04-cc28364351de None admin] RBAC: Authorizing `identity:get_user(user_id=8ddd0063417e47b1951ef74eb0aca79c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.226516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918b586-096a-4203-9a04-cc28364351de None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.228172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 544/1079] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:14:57 2022] GET /identity/v3/users/8ddd0063417e47b1951ef74eb0aca79c => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:14:57.234655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918b586-096a-4203-9a04-cc28364351de None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:57.240847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3fb4f-2cde-4292-a00f-fe5192e0910b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.283220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.283864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.284601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.284601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.291896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.294175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:14:57.305531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:57.306581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:14:57.307494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 536/1080] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:57.314666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:57.341552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:57.356078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918b586-096a-4203-9a04-cc28364351de None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.395440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.396459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.397269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.397269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.398354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] RBAC: Authorizing `identity:get_project(project_id=94b289279d4243ff9a21cc137d3ae019)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.400167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.402373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 545/1081] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:14:57 2022] GET /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:57.408215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:57.435320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4eb55-76a6-46ed-a04b-5a03683264dc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.470513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.471121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.471401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.471675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.472395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:14:57.472702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.474119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.481685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:57.487720 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 537/1082] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:14:57.493759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:57.507533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95665f8-e243-4d14-b1ba-733b3fa1dd1d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.541447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01106a-c643-4fbd-a61c-58b0a4be8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.542168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01106a-c643-4fbd-a61c-58b0a4be8b83 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.542452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01106a-c643-4fbd-a61c-58b0a4be8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.542878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01106a-c643-4fbd-a61c-58b0a4be8b83 None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019/users/8ddd0063417e47b1951ef74eb0aca79c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.544904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01106a-c643-4fbd-a61c-58b0a4be8b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=94b289279d4243ff9a21cc137d3ae019, user_id=8ddd0063417e47b1951ef74eb0aca79c, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.546348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01106a-c643-4fbd-a61c-58b0a4be8b83 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.559588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 546/1083] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:57 2022] PUT /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019/users/8ddd0063417e47b1951ef74eb0aca79c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:14:57.600518 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9166b3-0765-48e1-ad79-1977ce3adbdc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:57.637583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4a4e-b892-42fc-b885-6859be0dedfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:57.638265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4a4e-b892-42fc-b885-6859be0dedfe None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:57.638546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4a4e-b892-42fc-b885-6859be0dedfe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:57.638816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4a4e-b892-42fc-b885-6859be0dedfe None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/880e3ed0ab1641a3bdab9ff349d09286/roles/4b9fb858181b408288f39926aa8f09b6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:57.641047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4a4e-b892-42fc-b885-6859be0dedfe None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=880e3ed0ab1641a3bdab9ff349d09286, role_id=4b9fb858181b408288f39926aa8f09b6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:14:57.642492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4a4e-b892-42fc-b885-6859be0dedfe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:14:57.657042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 538/1084] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:14:57 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/880e3ed0ab1641a3bdab9ff349d09286/roles/4b9fb858181b408288f39926aa8f09b6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:14:59.430218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4bb9f-fa08-4ca3-abaf-a6018f688b39 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:59.430748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4bb9f-fa08-4ca3-abaf-a6018f688b39 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:59.430834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4bb9f-fa08-4ca3-abaf-a6018f688b39 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:59.432140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 547/1085] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:59.437824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f2e0-eb5d-4074-bad4-d84647a06fcc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:59.438224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f2e0-eb5d-4074-bad4-d84647a06fcc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:59.438530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f2e0-eb5d-4074-bad4-d84647a06fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:59.457024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-72c9f2e0-eb5d-4074-bad4-d84647a06fcc None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:59.458188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-72c9f2e0-eb5d-4074-bad4-d84647a06fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:59.508985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:59.525127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 539/1086] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:59.564694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f601cbf-3e34-4ae1-bba3-183a3eba1a29 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:59.564980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f601cbf-3e34-4ae1-bba3-183a3eba1a29 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:59.565287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f601cbf-3e34-4ae1-bba3-183a3eba1a29 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:59.566640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 548/1087] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:14:59.571748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:59.572042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:59.572351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:59.591059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:14:59.592277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:14:59.658311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 540/1088] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:14:59.790321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f601cbf-3e34-4ae1-bba3-183a3eba1a29 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:59.811267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:14:59.894197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f601cbf-3e34-4ae1-bba3-183a3eba1a29 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:14:59.928543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:14:59.929181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:14:59.929461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:14:59.929775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:14:59.932109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:14:59.940791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:14:59.945497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:14:59.946516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:14:59.947897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 549/1089] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:14:59.952482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.035461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.040274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0169b1-4842-4e98-a06e-6cfde5f74c89 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.058916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85447-fa85-4b17-932c-42f7d9daf1a8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.059751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.077026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.077656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.077937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.078207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.088468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:00.092682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.093285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.093560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:00.093654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:00.094684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 19:15:00.095661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:00.096760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.096760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:00.096760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.096986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 541/1090] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 17 19:14:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:15:00.097069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.100649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.104453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 550/1091] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.110319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.202983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00950-c569-4441-9216-5ad2e8c4b584 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.209603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dda74-d692-4de9-9b06-f66f22a07ab2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.237313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.237909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.238187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.238454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.239132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:00.239430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.240819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.243574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.244199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.244514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.244786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] PATH_INFO: `/v3/users/8ddd0063417e47b1951ef74eb0aca79c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.245941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] RBAC: Authorizing `identity:get_user(user_id=8ddd0063417e47b1951ef74eb0aca79c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.247344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.248644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 542/1092] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.253516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 551/1093] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/users/8ddd0063417e47b1951ef74eb0aca79c => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.254247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.254442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.265932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.297507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.353546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4dbc1-47fe-4474-ab07-55fd10a0fd39 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.354809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea56b2-0669-4332-94ed-bf5e4618dfaa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.387042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.387639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.387919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.388193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.388705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.389329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.389614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.390002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.403098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.404912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:15:00.420606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:00.421587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:15:00.422520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:15:00.422520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:15:00.422520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:00.422520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 543/1094] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:00.427637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.461213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.462672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.472755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.520388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.530091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a677e-a637-4b38-90e6-9d2e5416d349 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.562323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.562921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.563196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.563466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.563884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 552/1095] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:00.564091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:00.564421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.565780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.569799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.582558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 544/1096] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.583463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.671768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463fa8b-7a74-4e9f-973d-7a05d95c3f58 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.682128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.683379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701108-2d38-4bda-afcb-a494b6c047e3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.709081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.709707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.709986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.710258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.711710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] RBAC: Authorizing `identity:get_project(project_id=94b289279d4243ff9a21cc137d3ae019)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.713220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.715665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 553/1097] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.719181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.719810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.720090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.720409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.721661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.728659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.730853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:15:00.743089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:00.744054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:00.745302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 545/1098] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:15:00.750024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.764984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:00.819492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218600c-33e9-41dd-aa78-35bae76aeae2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.848447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce270-ac72-4097-8bdf-6e8aa7f232f6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:00.855644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.856277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.856559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.856834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.857556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=94b289279d4243ff9a21cc137d3ae019, user.id=8ddd0063417e47b1951ef74eb0aca79c) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:00.857866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.859401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.865243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 554/1099] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/role_assignments?user.id=8ddd0063417e47b1951ef74eb0aca79c&scope.project.id=94b289279d4243ff9a21cc137d3ae019&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.882397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:00.883028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:00.883306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:00.883579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:00.884357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:00.884671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:00.886130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:00.910287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 546/1100] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:00.916376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:00.962658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:01.025565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ad60-25e6-471a-a736-1707dae25309 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:01.059491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:01.060115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:01.060418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:01.060693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:01.135889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:01.138027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:01.178072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:01.237556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 555/1101] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:01.243345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:01.313203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:01.344787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042693-2071-49cb-b225-cd62fe47d96a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:01.382568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:01.383207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:01.383489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:01.383765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:01.393688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:01.395501 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:15:01.410320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:01.411483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:15:01.412796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:15:01.412796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:15:01.412796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:01.416187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 547/1102] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:01.417985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:01.515899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6986a-2369-44ab-9f60-04aeaa25d4c9 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:01.550010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:01.550616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:01.550895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:01.551168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:01.551800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:01.552100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:01.553490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:01.562339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:01.568418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 556/1103] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:01.571045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:01.669672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b032a8-bd4e-4693-9dd2-36be371951a5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:01.690978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:01.703109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:01.703732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:01.704299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:01.704580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:01.710992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:01.712447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:15:01.723958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:01.724875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:01.725773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 548/1104] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:01.731755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:01.830508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08499-2be9-4061-b142-25d840ac0e4c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:01.865323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:01.865940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:01.866223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:01.866496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:01.867187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:01.867496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:01.868959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14dee-c570-413a-ad4f-35b907dcc629 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:01.881931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 557/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:01.887796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:01.989705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39e81-aa34-4171-b0b7-ca21225b1dc0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:02.024707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:02.025310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:02.025586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:02.025852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:02.026581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] RBAC: Adding query filter params (role.id=4b9fb858181b408288f39926aa8f09b6, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=880e3ed0ab1641a3bdab9ff349d09286) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:02.027438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:02.028905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dffda8-7a8d-4fd0-aab4-0a4636821e97 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:02.034690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 549/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:01 2022] GET /identity/v3/role_assignments?user.id=880e3ed0ab1641a3bdab9ff349d09286&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=4b9fb858181b408288f39926aa8f09b6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:02.796029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4b631-6f71-4473-afd3-de8446755ff4 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:02.796566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4b631-6f71-4473-afd3-de8446755ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:02.796683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4b631-6f71-4473-afd3-de8446755ff4 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:02.797961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 558/1107] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:15:02.803339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2633-073e-470b-994f-43e032a2c351 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:02.803735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2633-073e-470b-994f-43e032a2c351 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:02.803891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2633-073e-470b-994f-43e032a2c351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:02.822546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-854e2633-073e-470b-994f-43e032a2c351 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:02.823859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-854e2633-073e-470b-994f-43e032a2c351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:02.866926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:02.892197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 550/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:03.161045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4b631-6f71-4473-afd3-de8446755ff4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:03.220858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:03.261785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4b631-6f71-4473-afd3-de8446755ff4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:03.294975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac9fd9-e8a2-49d6-b941-513bf83f4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:03.295627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9fd9-e8a2-49d6-b941-513bf83f4c56 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:03.295905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9fd9-e8a2-49d6-b941-513bf83f4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:03.296172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9fd9-e8a2-49d6-b941-513bf83f4c56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:03.297291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac9fd9-e8a2-49d6-b941-513bf83f4c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:03.298704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac9fd9-e8a2-49d6-b941-513bf83f4c56 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:03.300271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 559/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:03.306100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2633-073e-470b-994f-43e032a2c351 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:03.401004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2633-073e-470b-994f-43e032a2c351 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:03.434820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19551-747a-4658-8a34-8cc65a9d051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:03.435351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19551-747a-4658-8a34-8cc65a9d051d None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:03.435627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19551-747a-4658-8a34-8cc65a9d051d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:03.435897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19551-747a-4658-8a34-8cc65a9d051d None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:03.436564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde19551-747a-4658-8a34-8cc65a9d051d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:03.437969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde19551-747a-4658-8a34-8cc65a9d051d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:03.458427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 551/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:15:03 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:15:05.380417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4783bf-2589-4937-af55-9cfb6a4430fa None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:05.381012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4783bf-2589-4937-af55-9cfb6a4430fa None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:05.381012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4783bf-2589-4937-af55-9cfb6a4430fa None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:05.382341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 560/1111] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:05.387662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:05.388095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:05.388199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:05.407610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:05.408831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:05.435167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:05.476442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 552/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:05.747511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4783bf-2589-4937-af55-9cfb6a4430fa None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:05.848014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4783bf-2589-4937-af55-9cfb6a4430fa None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:05.881453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:05.892833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:05.893753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:05.894175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:05.894591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] PATH_INFO: `/v3/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:05.896719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] RBAC: Authorizing `identity:get_role(role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:05.898887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:05.901023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 561/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:05 2022] GET /identity/v3/roles/f5ae841af58449728d99fd785708f1ae => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:05.907538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:06.005360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7ccf-3a4d-4772-a304-e1d79d7097c3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:06.039082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:06.039701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:06.039983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:06.040273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] PATH_INFO: `/v3/users/f89b3c0c3d1d4c268c22e1818622fc2c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:06.052913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] RBAC: Authorizing `identity:get_user(user_id=f89b3c0c3d1d4c268c22e1818622fc2c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:06.054323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:06.055898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 553/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:05 2022] GET /identity/v3/users/f89b3c0c3d1d4c268c22e1818622fc2c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:06.061899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:06.158533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fbc4-a8a4-4426-a365-216da5c4a67c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:06.190455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:06.191044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:06.191319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:06.191589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:06.257750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:06.265528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:06.266981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:06.366841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 562/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:06.373366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:06.394831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:06.471744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1773f-d9ca-49b0-aba1-5be03a8d5152 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:06.504530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb120-fd4a-4f45-9bd7-fbbf031e494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:06.505149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb120-fd4a-4f45-9bd7-fbbf031e494d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:06.505430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb120-fd4a-4f45-9bd7-fbbf031e494d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:06.505703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb120-fd4a-4f45-9bd7-fbbf031e494d None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:06.506794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb120-fd4a-4f45-9bd7-fbbf031e494d None admin] RBAC: Authorizing `identity:get_project(project_id=94b289279d4243ff9a21cc137d3ae019)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:06.508285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb120-fd4a-4f45-9bd7-fbbf031e494d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:06.509832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 554/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:06 2022] GET /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:06.516515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:06.609591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:06.616150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a3b9d-ac95-4fe3-a216-96885ce2afc2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:06.649832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:06.650429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:06.650706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:06.650975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:06.651717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] RBAC: Adding query filter params (role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=94b289279d4243ff9a21cc137d3ae019, user.id=f89b3c0c3d1d4c268c22e1818622fc2c) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:06.652021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:06.653485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01acfb8-cd13-4cd1-a2cf-aa1025db8376 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:06.658653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 563/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:06 2022] GET /identity/v3/role_assignments?user.id=f89b3c0c3d1d4c268c22e1818622fc2c&scope.project.id=94b289279d4243ff9a21cc137d3ae019&role.id=f5ae841af58449728d99fd785708f1ae => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:08.496819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ad4c5-3cd4-4487-894e-13ce66027ea2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:08.497345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ad4c5-3cd4-4487-894e-13ce66027ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:08.497345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ad4c5-3cd4-4487-894e-13ce66027ea2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:08.498688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 555/1118] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:08.503720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:08.504137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:08.504316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:08.522625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:08.523810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:08.588473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 564/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:15:08.853782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ad4c5-3cd4-4487-894e-13ce66027ea2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:08.941946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:08.955804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ad4c5-3cd4-4487-894e-13ce66027ea2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:08.989082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:08.989701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:08.989978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:08.990249 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] PATH_INFO: `/v3/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:08.991625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] RBAC: Authorizing `identity:get_role(role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:08.993005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:08.994316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 556/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:08 2022] GET /identity/v3/roles/f5ae841af58449728d99fd785708f1ae => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:09.000702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:09.086980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:09.097691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ba7d-93a0-4891-8e01-cf82cb212054 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:09.130208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:09.130772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:09.131049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:09.131320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] PATH_INFO: `/v3/users/f89b3c0c3d1d4c268c22e1818622fc2c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:09.132447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] RBAC: Authorizing `identity:get_user(user_id=f89b3c0c3d1d4c268c22e1818622fc2c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:09.133886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:09.135441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 565/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:08 2022] GET /identity/v3/users/f89b3c0c3d1d4c268c22e1818622fc2c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:09.141917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:09.246503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2310b-74d8-402a-bea8-51218f242797 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:09.279873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5865680-03bb-4bb6-8879-2f815b3af071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:09.280521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865680-03bb-4bb6-8879-2f815b3af071 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:09.280801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865680-03bb-4bb6-8879-2f815b3af071 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:09.281072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5865680-03bb-4bb6-8879-2f815b3af071 None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:09.282177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5865680-03bb-4bb6-8879-2f815b3af071 None admin] RBAC: Authorizing `identity:get_project(project_id=94b289279d4243ff9a21cc137d3ae019)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:09.283602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5865680-03bb-4bb6-8879-2f815b3af071 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:09.285252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 557/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:09 2022] GET /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:09.291273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:09.388577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74b56e-cfbd-4c33-b274-c039fc7ac58f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:09.419916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e36eb4-5665-4b83-9f9c-e0809190b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:09.420581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e36eb4-5665-4b83-9f9c-e0809190b4ef None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:09.420883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e36eb4-5665-4b83-9f9c-e0809190b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:09.421152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e36eb4-5665-4b83-9f9c-e0809190b4ef None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019/users/f89b3c0c3d1d4c268c22e1818622fc2c/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:09.423223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e36eb4-5665-4b83-9f9c-e0809190b4ef None admin] RBAC: Authorizing `identity:create_grant(project_id=94b289279d4243ff9a21cc137d3ae019, user_id=f89b3c0c3d1d4c268c22e1818622fc2c, role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:09.424669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e36eb4-5665-4b83-9f9c-e0809190b4ef None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:09.437380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 566/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:15:09 2022] PUT /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019/users/f89b3c0c3d1d4c268c22e1818622fc2c/roles/f5ae841af58449728d99fd785708f1ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:15:11.374030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f6bc-60a2-4824-8757-fd790d3543c0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:11.374578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f6bc-60a2-4824-8757-fd790d3543c0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:11.374578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f6bc-60a2-4824-8757-fd790d3543c0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:11.375916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 558/1124] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:11.381094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:11.381505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:11.381642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:11.399789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:11.400996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:11.414388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:11.467884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 567/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:11.734105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f6bc-60a2-4824-8757-fd790d3543c0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:11.759334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:11.835185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f6bc-60a2-4824-8757-fd790d3543c0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:11.868755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:11.869398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:11.869701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:11.869997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] PATH_INFO: `/v3/roles/f5ae841af58449728d99fd785708f1ae` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:11.872265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] RBAC: Authorizing `identity:get_role(role_id=f5ae841af58449728d99fd785708f1ae)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:11.873729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:11.875162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 559/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:11 2022] GET /identity/v3/roles/f5ae841af58449728d99fd785708f1ae => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:11.880906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:11.975946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb220-3483-4781-80ef-d3c5ecd000f9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:12.009660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:12.010299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:12.010582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:12.010859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] PATH_INFO: `/v3/users/f89b3c0c3d1d4c268c22e1818622fc2c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:12.012345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f89b3c0c3d1d4c268c22e1818622fc2c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:12.013782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:12.015360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 568/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:11 2022] GET /identity/v3/users/f89b3c0c3d1d4c268c22e1818622fc2c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:12.021045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:12.111201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:12.120065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb651-36e2-4a6e-87f4-12aee3bbac28 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:12.153772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761411ce-4657-466e-b974-29dbec126881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:12.154369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761411ce-4657-466e-b974-29dbec126881 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:12.154649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761411ce-4657-466e-b974-29dbec126881 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:12.154925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761411ce-4657-466e-b974-29dbec126881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:12.219646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761411ce-4657-466e-b974-29dbec126881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:12.221089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761411ce-4657-466e-b974-29dbec126881 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:12.307293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:12.317105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 560/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:12.323002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:12.341803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:12.419958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc2231-d03d-441e-831e-15d7c5e52bd6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:12.452064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5884be-073d-44cd-828b-abce5cb04f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:12.452717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5884be-073d-44cd-828b-abce5cb04f81 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:12.452999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5884be-073d-44cd-828b-abce5cb04f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:12.453274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5884be-073d-44cd-828b-abce5cb04f81 None admin] PATH_INFO: `/v3/projects/94b289279d4243ff9a21cc137d3ae019` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:12.454632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5884be-073d-44cd-828b-abce5cb04f81 None admin] RBAC: Authorizing `identity:get_project(project_id=94b289279d4243ff9a21cc137d3ae019)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:12.456064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5884be-073d-44cd-828b-abce5cb04f81 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:12.457708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 569/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:12 2022] GET /identity/v3/projects/94b289279d4243ff9a21cc137d3ae019 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:12.463764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761411ce-4657-466e-b974-29dbec126881 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:12.561614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761411ce-4657-466e-b974-29dbec126881 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:12.595003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:12.595591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:12.595869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:12.596133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:12.596867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] RBAC: Adding query filter params (role.id=f5ae841af58449728d99fd785708f1ae, scope.project.id=94b289279d4243ff9a21cc137d3ae019, user.id=f89b3c0c3d1d4c268c22e1818622fc2c) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:12.597168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:12.598561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb3e4a-2c9b-4863-89af-1e61dd8d29ae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:12.603991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 561/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:12 2022] GET /identity/v3/role_assignments?user.id=f89b3c0c3d1d4c268c22e1818622fc2c&scope.project.id=94b289279d4243ff9a21cc137d3ae019&role.id=f5ae841af58449728d99fd785708f1ae => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:14.520788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706647-0bba-4931-95ed-683957d7c8d8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:14.521336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706647-0bba-4931-95ed-683957d7c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:14.521336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706647-0bba-4931-95ed-683957d7c8d8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:14.522689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 570/1131] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:14.527931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:14.528353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:14.528522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:14.546738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:14.547932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:14.597840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:14.614343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 562/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:14.884426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706647-0bba-4931-95ed-683957d7c8d8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:14.969467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:14.986172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706647-0bba-4931-95ed-683957d7c8d8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:15.019584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9776-00cb-4d3c-944c-79a7f8fcafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:15.020205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9776-00cb-4d3c-944c-79a7f8fcafaa None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:15.020508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9776-00cb-4d3c-944c-79a7f8fcafaa None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:15.020773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9776-00cb-4d3c-944c-79a7f8fcafaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:15.021864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9776-00cb-4d3c-944c-79a7f8fcafaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:15.023272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9776-00cb-4d3c-944c-79a7f8fcafaa None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:15.024844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 571/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:15:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:15.031351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:15.127313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd7014-27ef-4fb6-bc54-8c6b11161907 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:15.160655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892435e-254d-4d0d-ac48-ea6da05a61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:15.161179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892435e-254d-4d0d-ac48-ea6da05a61b4 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:15.161452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892435e-254d-4d0d-ac48-ea6da05a61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:15.161718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892435e-254d-4d0d-ac48-ea6da05a61b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:15.162350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892435e-254d-4d0d-ac48-ea6da05a61b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:15.163744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892435e-254d-4d0d-ac48-ea6da05a61b4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:15.190016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 563/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:15:15 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:15:17.097866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec11e-fa45-4d13-88f2-7496db11cdab None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:17.098386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec11e-fa45-4d13-88f2-7496db11cdab None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:17.098386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec11e-fa45-4d13-88f2-7496db11cdab None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:17.099736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 572/1135] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:17.105281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:17.105663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:17.105855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:17.123846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:17.125069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:17.154856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:17.191257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 564/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:17.465928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec11e-fa45-4d13-88f2-7496db11cdab None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:17.564100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec11e-fa45-4d13-88f2-7496db11cdab None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:17.599212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef7521-88de-4a91-89eb-64368640b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:17.599831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef7521-88de-4a91-89eb-64368640b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:17.600105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef7521-88de-4a91-89eb-64368640b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:17.600398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef7521-88de-4a91-89eb-64368640b8c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:17.601471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef7521-88de-4a91-89eb-64368640b8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:17.602884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef7521-88de-4a91-89eb-64368640b8c4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:17.604485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 573/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:17.610289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:17.718087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad02fc-e7d4-4760-b38e-cf51337c8339 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:17.751505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bdd3b-c154-4d78-8516-28a6ac09b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:17.752105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bdd3b-c154-4d78-8516-28a6ac09b8b3 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:17.752417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bdd3b-c154-4d78-8516-28a6ac09b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:17.752688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bdd3b-c154-4d78-8516-28a6ac09b8b3 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:17.753326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bdd3b-c154-4d78-8516-28a6ac09b8b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:17.754739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bdd3b-c154-4d78-8516-28a6ac09b8b3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:17.775537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 565/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:15:17 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:15:19.714440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff195a-ccdb-440a-a81c-fa27edc98532 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:19.714995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff195a-ccdb-440a-a81c-fa27edc98532 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:19.714995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff195a-ccdb-440a-a81c-fa27edc98532 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:19.716342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 574/1139] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:19.721391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:19.721764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:19.721951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:19.740355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:19.741528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:19.758108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:19.806822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 566/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:20.076003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff195a-ccdb-440a-a81c-fa27edc98532 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:20.098092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:20.175206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff195a-ccdb-440a-a81c-fa27edc98532 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:20.208197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:20.208846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.209126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.209397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:20.219771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:20.224492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:20.225661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:15:20.226750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 575/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:20.231546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:20.327451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7d0ca-8932-451b-a323-3a6a31090c54 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:20.361428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:20.362027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.362302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.362570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:20.363227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:20.363526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:20.364899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:20.372764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 567/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:20.378688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:20.459651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:20.478467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130614-7a63-41ae-b660-a32c23cabe65 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:20.511741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:20.512383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.512667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.512940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] PATH_INFO: `/v3/users/7fb1c2babf57485fb64d6cd46a7d4ada` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:20.525489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=7fb1c2babf57485fb64d6cd46a7d4ada)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:20.527103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:20.528721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 576/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:20 2022] GET /identity/v3/users/7fb1c2babf57485fb64d6cd46a7d4ada => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:20.534592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:20.552735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:20.633590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93af87-29df-4d9d-a41d-26447dbc6056 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:20.665891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:20.666484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.666763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.667033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:20.731639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:20.733091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:20.749577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:20.829447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 568/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:20.835235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:20.930728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6881b-e426-429e-a3cb-3ad1d7deb5e5 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:20.964185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b100f6-cf3c-4b70-93e9-c611b93c74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:20.964825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b100f6-cf3c-4b70-93e9-c611b93c74a7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.965102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b100f6-cf3c-4b70-93e9-c611b93c74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.965375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b100f6-cf3c-4b70-93e9-c611b93c74a7 None admin] PATH_INFO: `/v3/projects/7b79659d2e1340f199aa274e4debe7ec` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:20.966468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b100f6-cf3c-4b70-93e9-c611b93c74a7 None admin] RBAC: Authorizing `identity:get_project(project_id=7b79659d2e1340f199aa274e4debe7ec)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:20.967917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b100f6-cf3c-4b70-93e9-c611b93c74a7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:20.969549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 577/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:20 2022] GET /identity/v3/projects/7b79659d2e1340f199aa274e4debe7ec => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:20.975639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:21.083397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f374b-738b-418f-91d3-a65d5ec8a95d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:21.099768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:21.117368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:21.117966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:21.118248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:21.118522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:21.119317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=7b79659d2e1340f199aa274e4debe7ec, user.id=7fb1c2babf57485fb64d6cd46a7d4ada) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:21.119629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:21.121189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e882f6c-b60d-4a63-b35e-d14391596235 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:21.126337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 569/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:20 2022] GET /identity/v3/role_assignments?user.id=7fb1c2babf57485fb64d6cd46a7d4ada&scope.project.id=7b79659d2e1340f199aa274e4debe7ec&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:23.023539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3678d-a22c-44e7-a160-15d8fb0a152a None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:23.024023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3678d-a22c-44e7-a160-15d8fb0a152a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:23.024141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3678d-a22c-44e7-a160-15d8fb0a152a None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:23.025449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 578/1147] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:23.031368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:23.031764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:23.031923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:23.049854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:23.051045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:23.121540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 570/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:23.416013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3678d-a22c-44e7-a160-15d8fb0a152a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:23.425223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:23.517030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3678d-a22c-44e7-a160-15d8fb0a152a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:23.549040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:23.549659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:23.549940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:23.550210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:23.560483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:23.565187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:23.566261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:15:23.567373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 579/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:23.572160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:23.671063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212c02-1147-4513-ab2c-81f245e171e8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:23.684628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:23.709250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:23.709855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:23.710139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:23.710413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:23.711073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:23.711376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:23.712766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:23.721044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 571/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:23.726883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:23.790328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:23.824121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bfc96-a734-4bb2-b9ed-2deb85f4620e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:23.858064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:23.858683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:23.858965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:23.859238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] PATH_INFO: `/v3/users/7fb1c2babf57485fb64d6cd46a7d4ada` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:23.860376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] RBAC: Authorizing `identity:get_user(user_id=7fb1c2babf57485fb64d6cd46a7d4ada)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:23.861807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:23.863372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 580/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:23 2022] GET /identity/v3/users/7fb1c2babf57485fb64d6cd46a7d4ada => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:23.869063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:23.969420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc796b-077d-4173-abc6-6c27378e3cd4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:24.002594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582dcd5-4a42-4a86-a6c3-fa8e71312a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:24.003226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582dcd5-4a42-4a86-a6c3-fa8e71312a47 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:24.003504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582dcd5-4a42-4a86-a6c3-fa8e71312a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:24.003776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582dcd5-4a42-4a86-a6c3-fa8e71312a47 None admin] PATH_INFO: `/v3/projects/7b79659d2e1340f199aa274e4debe7ec` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:24.005105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582dcd5-4a42-4a86-a6c3-fa8e71312a47 None admin] RBAC: Authorizing `identity:get_project(project_id=7b79659d2e1340f199aa274e4debe7ec)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:24.006322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582dcd5-4a42-4a86-a6c3-fa8e71312a47 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:24.007944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 572/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:23 2022] GET /identity/v3/projects/7b79659d2e1340f199aa274e4debe7ec => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:24.014411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:24.114482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181dd5b-0e7a-47db-92c5-c3a60cc3d90f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:24.147817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303c6f7-9702-4be4-8503-f074cda9dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:24.148493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c6f7-9702-4be4-8503-f074cda9dedf None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:24.148778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c6f7-9702-4be4-8503-f074cda9dedf None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:24.149053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c6f7-9702-4be4-8503-f074cda9dedf None admin] PATH_INFO: `/v3/projects/7b79659d2e1340f199aa274e4debe7ec/users/7fb1c2babf57485fb64d6cd46a7d4ada/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:24.150939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c6f7-9702-4be4-8503-f074cda9dedf None admin] RBAC: Authorizing `identity:create_grant(project_id=7b79659d2e1340f199aa274e4debe7ec, user_id=7fb1c2babf57485fb64d6cd46a7d4ada, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:24.153543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c6f7-9702-4be4-8503-f074cda9dedf None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:24.155695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:24.166938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 581/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:15:24 2022] PUT /identity/v3/projects/7b79659d2e1340f199aa274e4debe7ec/users/7fb1c2babf57485fb64d6cd46a7d4ada/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:15:26.042430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc859b6-8bba-427b-bf9d-384de9736aed None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:26.043109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc859b6-8bba-427b-bf9d-384de9736aed None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:26.043275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc859b6-8bba-427b-bf9d-384de9736aed None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:26.044556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 573/1154] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:26.049749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:26.050159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:26.050304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:26.067967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:26.069186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:26.133856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 582/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:26.420582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc859b6-8bba-427b-bf9d-384de9736aed None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:26.463508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:26.520360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc859b6-8bba-427b-bf9d-384de9736aed None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:26.552417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:26.553044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:26.553328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:26.553605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:26.563931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:26.568653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:26.569752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:26.570804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 574/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:26.576824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:26.671388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f3389-0ac5-4cf1-9265-3c028afe47b0 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:26.694606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:26.706800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:26.707398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:26.707672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:26.707938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:26.708625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:26.708923 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:26.710281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:26.718245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 583/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:26.724023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:26.819123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:26.821942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745aeae-21c1-48e5-981e-275bb55ad385 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:26.855903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:26.856549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:26.856830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:26.857103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] PATH_INFO: `/v3/users/7fb1c2babf57485fb64d6cd46a7d4ada` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:26.858203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] RBAC: Authorizing `identity:get_user(user_id=7fb1c2babf57485fb64d6cd46a7d4ada)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:26.859625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:26.861221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 575/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:26 2022] GET /identity/v3/users/7fb1c2babf57485fb64d6cd46a7d4ada => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:26.867039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:26.963461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4597-b76c-4de9-8891-a9de77a648eb None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:26.995751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:26.996383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:26.996663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:26.996934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:27.049903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:27.063351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:27.064833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:27.161888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 584/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:27.167899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:27.266283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9d8e-4607-4521-a4a9-b4d57213b04a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:27.298552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b1e2-6e6a-4caa-bbc0-b32fadad2bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:27.299170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b1e2-6e6a-4caa-bbc0-b32fadad2bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:27.299448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b1e2-6e6a-4caa-bbc0-b32fadad2bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:27.299718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b1e2-6e6a-4caa-bbc0-b32fadad2bc5 None admin] PATH_INFO: `/v3/projects/7b79659d2e1340f199aa274e4debe7ec` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:27.300836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3b1e2-6e6a-4caa-bbc0-b32fadad2bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=7b79659d2e1340f199aa274e4debe7ec)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:27.302247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3b1e2-6e6a-4caa-bbc0-b32fadad2bc5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:27.303851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 576/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:27 2022] GET /identity/v3/projects/7b79659d2e1340f199aa274e4debe7ec => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:15:27.310696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:27.394000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:27.409597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eae5d-7750-48ef-b0b4-ac958255159e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:27.442791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:27.443375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:27.443803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:27.444094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:27.444841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=7b79659d2e1340f199aa274e4debe7ec, user.id=7fb1c2babf57485fb64d6cd46a7d4ada) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:27.445152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:27.446572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ed1a4-c804-4684-8c90-b6129bded291 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:27.452999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 585/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:27 2022] GET /identity/v3/role_assignments?user.id=7fb1c2babf57485fb64d6cd46a7d4ada&scope.project.id=7b79659d2e1340f199aa274e4debe7ec&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:29.353243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b9bb-ca9b-4eb0-91d0-6e1f6ab12875 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:29.353779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b9bb-ca9b-4eb0-91d0-6e1f6ab12875 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:29.353779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b9bb-ca9b-4eb0-91d0-6e1f6ab12875 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:29.355801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 577/1162] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:29.360896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:29.361303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:29.361453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:29.379622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:29.380817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:29.444477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 586/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:29.724889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b9bb-ca9b-4eb0-91d0-6e1f6ab12875 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:29.769350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:29.834835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b9bb-ca9b-4eb0-91d0-6e1f6ab12875 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:29.867912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:29.868547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:29.868829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:29.869102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:29.934607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:29.936045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:29.967688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:30.031126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 578/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:30.037149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:30.114182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:30.133507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875399df-be93-4450-8d10-309b4e4e5347 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:30.165919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:30.167173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:30.167601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:30.167879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:30.174277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:30.175725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-c33a4507-1e59-47ed-829f-6ecf2a117d2c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:30.187395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:30.188595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:15:30.189622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 587/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:15:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:30.194610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:30.292165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6add9a6-58ba-4cdc-a7a2-e9713dfb6d8b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:30.324633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:30.325226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:30.325503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:30.325771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:30.326399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:30.326696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:30.328037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a60be-b7f8-48b2-afe6-984a0b18f8d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:30.330565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:30.336967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 579/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 17 19:15:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:32.290188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1445-f87d-4391-848a-1aa51a2dbca2 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:32.290753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1445-f87d-4391-848a-1aa51a2dbca2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:32.291195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e1445-f87d-4391-848a-1aa51a2dbca2 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:32.293166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 588/1167] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:32.298559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098e96-1a63-4e35-9206-9aa8fe5a843e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:32.299012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098e96-1a63-4e35-9206-9aa8fe5a843e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:32.299130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098e96-1a63-4e35-9206-9aa8fe5a843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:32.318440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fd098e96-1a63-4e35-9206-9aa8fe5a843e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:32.319630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fd098e96-1a63-4e35-9206-9aa8fe5a843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:32.387975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 580/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:32.666212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1445-f87d-4391-848a-1aa51a2dbca2 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:32.766251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e1445-f87d-4391-848a-1aa51a2dbca2 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:32.799290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1b045-4516-4eb0-a35b-d6d930952662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:32.799889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b045-4516-4eb0-a35b-d6d930952662 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:32.800166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b045-4516-4eb0-a35b-d6d930952662 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:32.800459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1b045-4516-4eb0-a35b-d6d930952662 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:32.801127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1b045-4516-4eb0-a35b-d6d930952662 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:32.802483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1b045-4516-4eb0-a35b-d6d930952662 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:32.813134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:32.819950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 589/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Wed Aug 17 19:15:32 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:15:34.736103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4615-faa8-4ca9-bb2c-ccf82c9ca30d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:34.736660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4615-faa8-4ca9-bb2c-ccf82c9ca30d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:34.736752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4615-faa8-4ca9-bb2c-ccf82c9ca30d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:34.738040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 581/1170] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:34.743177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:34.743579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:34.743734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:34.762507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:34.763698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:34.828608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 590/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:35.093059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb4615-faa8-4ca9-bb2c-ccf82c9ca30d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:35.194597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb4615-faa8-4ca9-bb2c-ccf82c9ca30d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:35.223227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:35.229942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca4649-7ed6-4642-8d90-225de93b2aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:35.230662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4649-7ed6-4642-8d90-225de93b2aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:35.230942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4649-7ed6-4642-8d90-225de93b2aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:35.231213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4649-7ed6-4642-8d90-225de93b2aa4 None admin] PATH_INFO: `/v3/domains/b53ab7d2b1d44b0fa16ac7d64c04f3c1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:35.241288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca4649-7ed6-4642-8d90-225de93b2aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b53ab7d2b1d44b0fa16ac7d64c04f3c1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:35.242758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca4649-7ed6-4642-8d90-225de93b2aa4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:35.244361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 582/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Wed Aug 17 19:15:35 2022] GET /identity/v3/domains/b53ab7d2b1d44b0fa16ac7d64c04f3c1 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:35.250774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:35.344299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68604f-1969-40b5-b6a6-a85f0ef4a394 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:35.372748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:35.379033 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2336d8-ffac-4faf-8b7d-f4ad8bc42063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:35.379636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2336d8-ffac-4faf-8b7d-f4ad8bc42063 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:35.379919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2336d8-ffac-4faf-8b7d-f4ad8bc42063 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:35.380192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2336d8-ffac-4faf-8b7d-f4ad8bc42063 None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:35.380868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2336d8-ffac-4faf-8b7d-f4ad8bc42063 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:35.382289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2336d8-ffac-4faf-8b7d-f4ad8bc42063 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:35.409605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 591/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:15:35 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:15:37.309960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544feee-b2e2-4817-ba0f-a1f08bc252a7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:37.310521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544feee-b2e2-4817-ba0f-a1f08bc252a7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:37.310521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544feee-b2e2-4817-ba0f-a1f08bc252a7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:37.311821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 583/1174] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:37.317092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:37.317536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:37.317636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:37.335899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:37.337114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:37.404131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 592/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:37.681611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544feee-b2e2-4817-ba0f-a1f08bc252a7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:37.785043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544feee-b2e2-4817-ba0f-a1f08bc252a7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:37.819020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b92ff7-5d73-4685-af69-e8e9b112d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:37.819642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92ff7-5d73-4685-af69-e8e9b112d397 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:37.819925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92ff7-5d73-4685-af69-e8e9b112d397 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:37.820204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b92ff7-5d73-4685-af69-e8e9b112d397 None admin] PATH_INFO: `/v3/domains/b53ab7d2b1d44b0fa16ac7d64c04f3c1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:37.821343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b92ff7-5d73-4685-af69-e8e9b112d397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b53ab7d2b1d44b0fa16ac7d64c04f3c1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:37.823597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b92ff7-5d73-4685-af69-e8e9b112d397 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:37.825409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 584/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Wed Aug 17 19:15:37 2022] GET /identity/v3/domains/b53ab7d2b1d44b0fa16ac7d64c04f3c1 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:37.832167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:37.931346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f537a-b1bf-466b-9bcf-69cdd16330fa None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:37.944412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:37.966694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebe160-fd84-424b-a6e6-7081fad55c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:37.967293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe160-fd84-424b-a6e6-7081fad55c7d None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:37.967575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe160-fd84-424b-a6e6-7081fad55c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:37.967845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe160-fd84-424b-a6e6-7081fad55c7d None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:37.968512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe160-fd84-424b-a6e6-7081fad55c7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:37.969926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe160-fd84-424b-a6e6-7081fad55c7d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:37.991597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 593/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:15:37 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:15:39.918220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631236-12b5-49fd-854e-e35cbc65ccda None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:39.918764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631236-12b5-49fd-854e-e35cbc65ccda None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:39.918764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07631236-12b5-49fd-854e-e35cbc65ccda None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:39.920117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 585/1178] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:39.925303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:39.925690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:39.925847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:39.943329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:39.944531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:40.010307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 594/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:40.280739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07631236-12b5-49fd-854e-e35cbc65ccda None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:40.343315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:40.385748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07631236-12b5-49fd-854e-e35cbc65ccda None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:40.419436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:40.420055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:40.420362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:40.420637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:40.430222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:40.434886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:40.436055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:40.437204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 586/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:40.442262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:40.536008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:40.541341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23210ebd-2111-4243-8f9c-23c1b6b1116e None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:40.576319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:40.576931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:40.577212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:40.577488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:40.580231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:40.580567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:40.581960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:40.596564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 595/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:15:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:40.602508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:40.701859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddd95-e79f-4d9a-a9e9-fd3c3625f545 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:40.718435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:40.734804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:40.735423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:40.735697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:40.735964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] PATH_INFO: `/v3/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:40.749033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] RBAC: Authorizing `identity:get_user(user_id=22bdd0c4d6e04d0591fd3d0bbe0a46e7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:40.750435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:40.752005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 587/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:40 2022] GET /identity/v3/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:40.757965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:40.855045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1ff41-a7d0-4cf7-9210-07f96c3b80ed None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:40.887741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:40.888363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:40.888644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:40.888913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:40.916696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:40.975624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:40.977092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:41.074620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 596/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:41.080786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:41.175546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04201-2af8-4420-bc24-6de36efb9d9b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:41.207930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c78e1-1dc5-4e41-934c-289bb5a40f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:41.208567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c78e1-1dc5-4e41-934c-289bb5a40f47 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:41.208845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c78e1-1dc5-4e41-934c-289bb5a40f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:41.209112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c78e1-1dc5-4e41-934c-289bb5a40f47 None admin] PATH_INFO: `/v3/projects/7f69829c45c5481dac25418246b15ef8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:41.210197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c78e1-1dc5-4e41-934c-289bb5a40f47 None admin] RBAC: Authorizing `identity:get_project(project_id=7f69829c45c5481dac25418246b15ef8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:41.211595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c78e1-1dc5-4e41-934c-289bb5a40f47 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:41.213240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 588/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:41 2022] GET /identity/v3/projects/7f69829c45c5481dac25418246b15ef8 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:41.219199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:41.278277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:41.317839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acae67-2fd2-4b92-8184-505259c4f986 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:41.350010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:41.350602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:41.350876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:41.351142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:41.351854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=7f69829c45c5481dac25418246b15ef8, user.id=22bdd0c4d6e04d0591fd3d0bbe0a46e7) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:41.352181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:41.354149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb857aba-830e-4bf2-9769-7e307c86e5b7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:41.359269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 597/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:41 2022] GET /identity/v3/role_assignments?user.id=22bdd0c4d6e04d0591fd3d0bbe0a46e7&scope.project.id=7f69829c45c5481dac25418246b15ef8&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:43.214300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9221-9060-4d6f-852c-3f499c198683 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:43.214838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9221-9060-4d6f-852c-3f499c198683 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:43.214838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e9221-9060-4d6f-852c-3f499c198683 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:43.216179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 589/1186] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:43.221251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:43.221662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:43.221776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:43.239168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:43.240369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:43.304536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 598/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:43.574190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9221-9060-4d6f-852c-3f499c198683 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:43.619614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:43.672875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e9221-9060-4d6f-852c-3f499c198683 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:43.706673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:43.707283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:43.707558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:43.707826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:43.717580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:43.722247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:43.723441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:15:43.724487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 590/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:15:43.729729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:43.784162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:43.828330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3e5b-d153-475f-8f3e-7ad73fabf14c None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:43.861400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:43.862031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:43.862313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:43.862584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:43.863250 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:43.863552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:43.864951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:43.873831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 599/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:43.879687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:43.988056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942c77a-4e63-49b9-8825-385b72ed9798 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:43.990500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:44.027758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:44.028423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:44.028706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:44.028980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] PATH_INFO: `/v3/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:44.030078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=22bdd0c4d6e04d0591fd3d0bbe0a46e7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:44.031504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:44.033112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 591/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:43 2022] GET /identity/v3/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:44.038926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:44.141577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4b9b-a135-4430-8def-7a0d4e6eae76 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:44.157104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:44.175359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c859bbc-0390-4cda-bab2-e7fe890ce280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:44.175989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859bbc-0390-4cda-bab2-e7fe890ce280 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:44.176296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859bbc-0390-4cda-bab2-e7fe890ce280 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:44.176575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c859bbc-0390-4cda-bab2-e7fe890ce280 None admin] PATH_INFO: `/v3/projects/7f69829c45c5481dac25418246b15ef8` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:44.177684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859bbc-0390-4cda-bab2-e7fe890ce280 None admin] RBAC: Authorizing `identity:get_project(project_id=7f69829c45c5481dac25418246b15ef8)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:44.179114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c859bbc-0390-4cda-bab2-e7fe890ce280 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:44.180773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 600/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:44 2022] GET /identity/v3/projects/7f69829c45c5481dac25418246b15ef8 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:44.188355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:44.283415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd83af-3352-4579-8439-76cf5bcf6ec9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:44.317005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b844fc-fe5a-4e98-ae33-c3261aa65daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:44.317640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b844fc-fe5a-4e98-ae33-c3261aa65daf None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:44.317913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b844fc-fe5a-4e98-ae33-c3261aa65daf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:44.318179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b844fc-fe5a-4e98-ae33-c3261aa65daf None admin] PATH_INFO: `/v3/projects/7f69829c45c5481dac25418246b15ef8/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:44.320002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b844fc-fe5a-4e98-ae33-c3261aa65daf None admin] RBAC: Authorizing `identity:create_grant(project_id=7f69829c45c5481dac25418246b15ef8, user_id=22bdd0c4d6e04d0591fd3d0bbe0a46e7, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:44.321443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b844fc-fe5a-4e98-ae33-c3261aa65daf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:44.333823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 592/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:15:44 2022] PUT /identity/v3/projects/7f69829c45c5481dac25418246b15ef8/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:15:46.188984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e8069-e033-49ec-b7d5-f77ef872fb1f None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:46.189522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e8069-e033-49ec-b7d5-f77ef872fb1f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:46.189522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e8069-e033-49ec-b7d5-f77ef872fb1f None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:46.190866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 601/1193] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:46.196214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:46.196621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:46.196800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:46.215402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:46.216618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:46.242222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:46.284403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 593/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:15:46.553491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e8069-e033-49ec-b7d5-f77ef872fb1f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:46.656775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e8069-e033-49ec-b7d5-f77ef872fb1f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:46.690462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:46.691080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:46.691361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:46.691637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:46.702328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:15:46.707315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:15:46.708415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:15:46.709444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 602/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:15:46.714437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:46.809710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dad6b-d61b-4233-8724-66b136447c45 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:46.842279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:46.842869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:46.843145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:46.843415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:46.844063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:46.844401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:46.845755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:46.853370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 594/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:46.859189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:46.904777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:46.958844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb75bb-2f11-487c-9538-d7b0d55efff7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:46.990880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:46.991499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:46.991775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:46.992042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] PATH_INFO: `/v3/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:46.993166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] RBAC: Authorizing `identity:get_user(user_id=22bdd0c4d6e04d0591fd3d0bbe0a46e7)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:46.995238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:46.996829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 603/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 17 19:15:46 2022] GET /identity/v3/users/22bdd0c4d6e04d0591fd3d0bbe0a46e7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:47.002733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:47.029144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:47.112660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc4a08-fbf4-47dd-95a0-b58db6f00c84 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:47.145987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:47.146587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:47.146870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:47.147144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:47.213618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:47.215055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:47.238248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:47.312800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 595/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:15:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:15:47.318692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:47.422423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecdd07-3495-4732-a591-e58ba2bfeca2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:47.434563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:47.455520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a469666-10da-4043-9f3b-0d6310242698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:47.456145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a469666-10da-4043-9f3b-0d6310242698 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:47.456452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a469666-10da-4043-9f3b-0d6310242698 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:47.456728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a469666-10da-4043-9f3b-0d6310242698 None admin] PATH_INFO: `/v3/projects/7f69829c45c5481dac25418246b15ef8` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:47.457828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a469666-10da-4043-9f3b-0d6310242698 None admin] RBAC: Authorizing `identity:get_project(project_id=7f69829c45c5481dac25418246b15ef8)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:47.459258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a469666-10da-4043-9f3b-0d6310242698 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:47.460911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 604/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 17 19:15:47 2022] GET /identity/v3/projects/7f69829c45c5481dac25418246b15ef8 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:47.467602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:47.564261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a66a7-7ecc-4817-870a-d4fed9936e58 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:47.586634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:47.597689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:47.598278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:47.598556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:47.598825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:47.599539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=7f69829c45c5481dac25418246b15ef8, user.id=22bdd0c4d6e04d0591fd3d0bbe0a46e7) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:15:47.599844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:47.601277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c6a8-785a-4a83-a815-c6b46e0ace05 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:47.607420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 596/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:15:47 2022] GET /identity/v3/role_assignments?user.id=22bdd0c4d6e04d0591fd3d0bbe0a46e7&scope.project.id=7f69829c45c5481dac25418246b15ef8&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:15:57.451104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=10 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:57.604921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:43.151816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba427-7f3e-462b-9763-d9692ed65b26 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:43.152567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba427-7f3e-462b-9763-d9692ed65b26 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:43.152567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba427-7f3e-462b-9763-d9692ed65b26 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:43.154039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 605/1201] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:43.159489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:43.159906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:43.160011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:43.182044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:43.183319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:43.264815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 597/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:16:43.566275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba427-7f3e-462b-9763-d9692ed65b26 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:43.708554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba427-7f3e-462b-9763-d9692ed65b26 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:43.754101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:43.754787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:43.755102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:43.755435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:43.767936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:43.769663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:43.789113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:43.790570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:43.791713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:43.791713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:43.791713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:16:43.791713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 606/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:16:43.796632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:43.928739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21dbd-5bb3-4230-8b99-b2643dee8d1c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:43.968846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:43.980702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:43.981394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:43.981748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:43.982079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:43.986874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:43.987222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:43.989055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054765a-1dfc-4ad1-b971-00476c49949b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:44.005943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 598/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:44.012682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:44.087657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:44.153774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fa24a-98e6-4d81-9077-bed81f3b49dd None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:44.200738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213e999-2d4a-4a4b-bcba-79428c19d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:44.201443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213e999-2d4a-4a4b-bcba-79428c19d368 None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:44.201725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213e999-2d4a-4a4b-bcba-79428c19d368 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:44.202051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213e999-2d4a-4a4b-bcba-79428c19d368 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:44.202748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213e999-2d4a-4a4b-bcba-79428c19d368 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:44.204185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213e999-2d4a-4a4b-bcba-79428c19d368 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:44.240293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 607/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 17 19:16:44 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:16:46.705521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c2cd-ceef-484e-97fd-bbc26fb03807 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:46.707655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c2cd-ceef-484e-97fd-bbc26fb03807 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:46.707655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c2cd-ceef-484e-97fd-bbc26fb03807 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:46.707655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 599/1206] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:46.713740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:46.714179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:46.714329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:46.734532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:46.736298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:46.821382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 608/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:16:47.105313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c2cd-ceef-484e-97fd-bbc26fb03807 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:47.230776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c2cd-ceef-484e-97fd-bbc26fb03807 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:47.269179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:47.269739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:47.270021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:47.270295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:47.282024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:16:47.286842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:47.289070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:47.290888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 600/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:47.295097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:47.345377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:47.418720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacfcb9-8abf-4b9c-81f3-0f5824f85f07 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:47.459059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:47.459920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:47.460079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:47.460318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:47.461972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:47.462474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:47.463929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:47.473659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 609/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:47.479866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:47.539611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:47.597359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03189-5473-4b8e-8923-0cc433d86921 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:47.637034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:47.637705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:47.637997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:47.638278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:47.651277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:47.653023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:47.672231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:47.673373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:47.674339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:47.674339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:47.674339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:47.676428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 601/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:47.680966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:47.812452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:47.815786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9f4cf-2496-4e86-8120-a57c270183e4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:47.867726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:47.868478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:47.868801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:47.869078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:47.869893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:47.870255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:47.871996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:47.887170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 610/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:47.892865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:48.018788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f84a39-a5cf-47b7-8a98-62718cf0c648 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:48.020577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:48.064369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:48.064898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:48.065211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:48.065447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:48.074390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:48.075939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:16:48.089948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:48.091111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:48.092074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 602/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:16:48.097737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:48.222149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4708cc-7993-4061-aa3a-aad2b7315cad None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:48.260124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:48.260765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:48.261078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:48.261453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:48.262364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:48.262777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:48.264433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:48.284771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 611/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 17 19:16:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:48.291359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:48.415547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad14d6-764c-43e5-81bf-e9675077e5db None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:48.475354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:48.476120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:48.476561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:48.477126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:48.518322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:48.561682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:48.563131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:48.682861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 603/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:16:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:16:48.688928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:48.711200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:48.814708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0f0e8-4fd8-4959-b53b-35889ba56c3a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:48.857138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:48.857763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:48.858060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:48.858359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:48.870227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:48.871574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:48.891344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:48.892558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:48.893726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:48.893726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:48.893726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:16:48.898198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:48.900302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 612/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:48.967276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:49.012608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dfdce-ef86-4800-92e3-11d0a637092e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:49.051392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:49.052003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.052311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.052586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:49.053246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:49.053550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:49.055145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:49.068291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 604/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:49.074262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:49.158348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:49.192594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fc7a3-3fa1-41db-b272-de666de56887 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:49.245726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:49.246292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.246565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.246836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:49.255412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:49.257010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:16:49.275417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:49.276542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:16:49.277423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 613/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:49.284743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:49.419290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364a45-48c8-4211-90d3-0a574ef7a343 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:49.463589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:49.482433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:49.483157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.483547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.483943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:49.484756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:49.485125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:49.486648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e333300-4dc5-4cdd-bdb4-e12e30c06696 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:49.501365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 605/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:49.507500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:49.636012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f1875-ac69-41df-bb87-02668b95d6f8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:49.669495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:49.675806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:49.676410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.676690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.676958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:49.677679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=d1f02d8a6f8b462094e147547c7a1a2c) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:49.677983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:49.679450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55882-286e-4e7b-bdfa-f2c7f84b567b None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:49.685283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 614/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:16:49 2022] GET /identity/v3/role_assignments?user.id=d1f02d8a6f8b462094e147547c7a1a2c&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:51.652916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185c4c-c00f-403a-a8b6-f01a9d537d4b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:51.653472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185c4c-c00f-403a-a8b6-f01a9d537d4b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:51.653605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185c4c-c00f-403a-a8b6-f01a9d537d4b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:51.655051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 606/1220] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:51.660940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:51.661350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:51.661476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:51.680427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:51.681756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:51.757514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 615/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:16:52.058219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185c4c-c00f-403a-a8b6-f01a9d537d4b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:52.168772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185c4c-c00f-403a-a8b6-f01a9d537d4b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.208025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.208697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.208983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.209257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.223482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:16:52.229423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:52.230525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:52.232693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 607/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:52.237860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:52.344460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e59b5f-9aae-4158-82ba-7a40d8c6ea9a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.370215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:52.381588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.382187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.382469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.382817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.383445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] RBAC: Adding query filter params (name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:52.383761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:52.385137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:52.397870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 616/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:52.400294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:52.459893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:52.524399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cceb4-4be3-473e-aa90-99483d1aabed None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.565873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.566506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.566781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.567049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.580126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:52.581990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:52.599121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:52.604498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:52.605611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:52.605611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:52.605611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:52.605611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 608/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:52.607528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:52.726029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec575a-b95d-42fb-988c-e3552ee6c387 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.771912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.772683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.773041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.773406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.775265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:52.775719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:52.777332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:52.791647 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 617/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:52.798413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:52.910408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:52.918953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ed72-e998-4b06-8cd7-09fe5532e6a1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.958629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.959273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.959713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.959930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.969253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:52.971252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:16:52.985152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:52.986232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:52.987455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 609/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:52.993426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:53.047676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:53.111458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8c8fb-c85c-46fb-ba38-66b7a97754e4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:53.155743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:53.156446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:53.156728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:53.156999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:53.157727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:53.158058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:53.159485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:53.177718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 618/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:53.184189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:53.302741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991f677-d9cb-4f53-a88c-49b604b8ebcb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:53.344564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:53.345191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:53.345479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:53.345777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:53.358118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:53.359907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:53.378204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:53.379356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:53.380446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:53.380446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:53.380446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:53.380446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 610/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:53.387067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:53.513761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ae45-037c-45bc-9625-23647ff8c65c None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:53.516689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:53.555698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:53.556441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:53.556723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:53.556987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:53.557773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:53.558096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:53.559624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:53.576294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 619/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:53.579220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:53.590605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:53.696647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733492c7-f538-495d-ad16-1dcfccd15a72 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:53.736684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:53.737317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:53.737597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:53.737870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:53.744640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:53.746099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:16:53.757259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:53.759021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:16:53.759902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:53.763889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 611/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:53.764975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:53.885771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470173-a4c1-4cb6-bb7b-4d2baaa35a1a None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:53.919436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:53.920062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:53.920333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:53.920594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:53.921351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:53.921573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:53.923111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b7530-4695-4f9c-b1e7-9187339cef8c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:53.935873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 620/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:53.942925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:54.022462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:54.064669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360b351-cced-4526-b279-e3fcfbf82887 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:54.104093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ac7eb-9005-4438-b501-042a70c85777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:54.104890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac7eb-9005-4438-b501-042a70c85777 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:54.105237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac7eb-9005-4438-b501-042a70c85777 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:54.105666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac7eb-9005-4438-b501-042a70c85777 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/d1f02d8a6f8b462094e147547c7a1a2c/roles/fe335c9f4bee403cbb77696f5c48a498` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:54.120990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ac7eb-9005-4438-b501-042a70c85777 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=d1f02d8a6f8b462094e147547c7a1a2c, role_id=fe335c9f4bee403cbb77696f5c48a498)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:54.122454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ac7eb-9005-4438-b501-042a70c85777 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:54.135230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 612/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:16:53 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/d1f02d8a6f8b462094e147547c7a1a2c/roles/fe335c9f4bee403cbb77696f5c48a498 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:16:56.069927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0d61-f10a-4399-8e58-39da1f4bee3f None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:56.071079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0d61-f10a-4399-8e58-39da1f4bee3f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:56.071079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac0d61-f10a-4399-8e58-39da1f4bee3f None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:56.072666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 621/1233] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:56.078184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:56.078623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:56.078734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:56.097894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:56.099149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:56.168857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 613/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:16:56.455428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0d61-f10a-4399-8e58-39da1f4bee3f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:56.484135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:56.573135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac0d61-f10a-4399-8e58-39da1f4bee3f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:56.608645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:56.609269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:56.609545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:56.609815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:56.621728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:16:56.626422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:56.627529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:16:56.628597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 622/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 17 19:16:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:56.634116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:56.685060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:56.744412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557ae97-2461-4873-b4db-4ec87eea88b6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:56.787508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:56.787952 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:56.788232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:56.788534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:56.789874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:56.790353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:56.791722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:56.800563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 614/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 17 19:16:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:56.806883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:56.901059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:56.920483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7bf9e-b8af-4ef5-8629-c94cb041fa46 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:56.957400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:56.958083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:56.958388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:56.958671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:56.970158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:56.971602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:56.988069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:56.989306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:56.990238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:56.990238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:56.990238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:16:56.990238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 623/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:16:56.996170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:57.109107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fafb5-79e8-483e-af92-33bc7dfb35fd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:57.119190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:57.146697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:57.147574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:57.148005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:57.148832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:57.149521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:57.149798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:57.151177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:57.171726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 615/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:57.173288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:57.286732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa51ca-96b9-41ce-8c2d-83276f794e48 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:57.323090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:57.323818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:57.324082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:57.324405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:57.327464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:57.333766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:57.335239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:16:57.347804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:57.348992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:16:57.349958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 624/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:57.355386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:57.491140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4fd9e-f301-45ed-831d-7c54f6033875 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:57.532659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:57.533524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:57.533809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:57.534086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:57.534882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:57.535175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:57.537006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:57.559763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 616/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 17 19:16:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:57.565701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:57.682079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668947f0-c5d0-4fdd-b3fe-7c08c248af98 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:57.723156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:57.723768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:57.724046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:57.724347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:57.798195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:57.806471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:57.809124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:57.936221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 625/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:16:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:16:57.942534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:57.977220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:58.069890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809782c-c43b-41b1-9442-483a5ef08d27 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:58.110798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:58.111459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:58.111727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:58.112003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:58.124081 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:58.125887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:16:58.142241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:58.143421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:16:58.144704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:16:58.144704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:16:58.144704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:58.144704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 617/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:58.149972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:58.279792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:58.287056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bfc6e-69a6-4901-842a-e623b44283c7 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:58.325663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:58.326189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:58.326467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:58.326736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:58.327371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:58.327670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:58.329061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:58.341220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 626/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:16:58.348621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:58.445353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:58.479800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c0bb-bca7-468e-9931-46076869835b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:58.516988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:58.517630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:58.517912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:58.518189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:58.526343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:58.528720 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:16:58.547037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:16:58.548193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:16:58.549363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:16:58.556263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 618/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:16:58.557588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:58.676681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e31952-fa41-44f8-bd99-6f19bb064d04 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:58.720174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:58.721018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:58.721392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:58.721766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:58.722934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:58.723366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:58.725097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64bc7-e405-4bd6-b9a6-db79c6ff90ed None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:58.749564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 627/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:16:58.750778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:58.869867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a371-8c70-47f8-921a-b241d8fcf0c1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:58.910613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:58.911221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:58.911497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:58.911767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:58.912524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] RBAC: Adding query filter params (role.id=fe335c9f4bee403cbb77696f5c48a498, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=d1f02d8a6f8b462094e147547c7a1a2c) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:16:58.912971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:58.914606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea747c9-f1ed-4fb9-ac52-222fe12fc6da None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:58.922036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 619/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:16:58 2022] GET /identity/v3/role_assignments?user.id=d1f02d8a6f8b462094e147547c7a1a2c&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=fe335c9f4bee403cbb77696f5c48a498 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:17:00.951058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837907b-add8-469d-8741-e54e64dcdbb8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:00.951767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837907b-add8-469d-8741-e54e64dcdbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:00.951767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837907b-add8-469d-8741-e54e64dcdbb8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:00.953121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 628/1247] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:00.958872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:00.959280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:00.959417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:00.967097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:00.982420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:00.983770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:01.066044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 620/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:01.411132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837907b-add8-469d-8741-e54e64dcdbb8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:01.437677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:01.545642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837907b-add8-469d-8741-e54e64dcdbb8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:01.592908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:01.593568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:01.593968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:01.594371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:01.606573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:17:01.611408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:01.613025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:01.614055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 629/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:17:01.619069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:01.723593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf5559-879d-4f54-9dc0-59f924f2317e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:01.754081 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:01.760674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:01.761289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:01.761571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:01.761848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:01.762514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:01.762817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:01.764279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:01.774150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 621/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:01.780214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:01.890100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:01.921189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac3b1-aaeb-47c4-9a1e-77a1f9911d4b None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:01.963370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:01.964330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:01.964556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:01.964829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:01.977781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:01.979704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:17:01.997865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:01.999070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:17:02.000535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:17:02.000535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:02.000535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:02.000535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 630/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:02.005717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:02.119979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e662-f529-4ed9-9783-86205e85643d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:02.154333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:02.154948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:02.155227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:02.155501 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:02.156142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:02.156481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:02.157836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:02.171528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 622/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:02.177510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:02.281291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74114a-8683-4f60-8c42-28c9f8a16cd6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:02.310075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:02.319257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:02.320016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:02.320418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:02.320627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:02.328646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:02.330362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:17:02.342527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:02.343768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:02.344903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 631/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:02.349668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:02.415105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:02.475541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3a9db-c31f-465d-a33a-c97d387100dc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:02.514797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:02.515410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:02.515684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:02.515968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:02.516725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:02.517033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:02.518444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:02.537803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 623/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 17 19:17:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:17:02.544197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:02.658872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847fc7-3ee5-4471-9a94-d0cbb55f651f None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:02.694219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:02.695547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:02.695547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:02.696115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:02.761795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:02.776471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:02.777986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:02.902317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 632/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:17:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 19:17:02.909577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:03.034305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40658634-462a-49b7-a020-d3fb48ee6ec5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:03.051822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:03.084299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:03.084299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:03.084299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:03.084299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:03.089804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:03.091277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:17:03.108019 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:03.109222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:17:03.110109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:17:03.110109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:03.110109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:03.110109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 624/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:17:03.115259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:03.209839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:03.223364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1492-b45d-44c0-92cc-1f4a60814f8e None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:03.259873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:03.260547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:03.260829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:03.261102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:03.261790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:03.262096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:03.263512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:03.281575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 633/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:03.282823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:03.387629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4769-8797-4d25-9b8b-6e03a737b333 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:03.426169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:03.426938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:03.427097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:03.427370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:03.435253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:03.436768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:17:03.449973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:03.456205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:03.457450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 625/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:03.459635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:03.562372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c35f-fd70-4102-88d4-730b7a252f40 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:03.596555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:03.597169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:03.597448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:03.597716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:03.598405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:03.598709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:03.600138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867d1b9-b215-47c7-b191-bfcbfc13227f None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:03.613185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 634/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:03.619430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:03.645312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:03.722969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca03b0d-d6da-4a18-84ca-323802eb1a59 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:03.756622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:03.757229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:03.757533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:03.757804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:03.758519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=d1f02d8a6f8b462094e147547c7a1a2c) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:03.758823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:03.760231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270bc4e-56e6-4a22-985e-f7ffdb73f60c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:03.765627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 626/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:17:03 2022] GET /identity/v3/role_assignments?user.id=d1f02d8a6f8b462094e147547c7a1a2c&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:17:05.631306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd581-804b-4478-b16b-5c4f9e2f015e None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:05.631827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd581-804b-4478-b16b-5c4f9e2f015e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:05.631918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd581-804b-4478-b16b-5c4f9e2f015e None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:05.633865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 635/1261] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:05.639277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:05.639722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:05.639828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:05.658497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:05.659677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:05.731798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 627/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:05.999328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afd581-804b-4478-b16b-5c4f9e2f015e None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:06.010842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.100149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afd581-804b-4478-b16b-5c4f9e2f015e None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:06.133411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:06.133951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:06.134225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:06.134495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:06.144179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:17:06.148820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:06.149916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:06.150955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 636/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:06.157957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:06.176390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.255692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b000a-1e60-409b-ae36-be8993f14f8e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:06.288005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:06.289187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:06.289495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:06.289788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:06.290448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:06.290753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:06.292111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:06.299860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 628/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:06.306224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:06.371541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.403407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35982da-aa0a-4bf7-8962-3ec8cc2b3661 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:06.443192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:06.444144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:06.444580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:06.445036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:06.456186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:06.457711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:17:06.473040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:06.474107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:17:06.475170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:17:06.475170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:06.475170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:06.475170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 637/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:06.482512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:06.572682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.592690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae5be1-35ab-40f1-8b1d-a2b0f1265279 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:06.626245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:06.626843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:06.627125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:06.627400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:06.628039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:06.628367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:06.629719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:06.641473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 629/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:06.647187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:06.745790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb8f0-c5a5-4fbc-bcc6-705de20c437d None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:06.765017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.779401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:06.780021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:06.780328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:06.780597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:06.787287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:06.789390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:17:06.800522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:06.806340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:06.807528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 638/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:06.808222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:06.906515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49d9d-dfbd-4566-87e4-2cd840c751c3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:06.940226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:06.940852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:06.941135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:06.941408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:06.942125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:06.942431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:06.943839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:06.952775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.963628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 630/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 17 19:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:17:06.969435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:07.066834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd56ef-740e-4dd3-8abb-a2c7dff844c4 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:07.099752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:07.100403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:07.100682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:07.100955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:07.111119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:07.112565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:17:07.126210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:07.127124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:17:07.128029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:17:07.128029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:07.128029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:07.128029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 639/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:07.133755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:07.230820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11961-a597-460c-b517-008ab839a439 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:07.263608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:07.264203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:07.264517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:07.264793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:07.265422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:07.265722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:07.267076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:07.278531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 631/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:17:07.284146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:07.315688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:07.383098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638766-3e1b-4b12-be56-8d14e52811a8 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:07.415174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:07.415841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:07.416112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:07.416409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:07.423191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:07.424693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:17:07.438081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:07.439140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:07.440287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 640/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:07.445520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:07.507539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:07.549238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01dc5-eac0-484b-b547-95327eebe454 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:07.582479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:07.583082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:07.583363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:07.583635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:07.584346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:07.584652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:07.586571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea764654-0ca8-48f0-b348-9ce0f40ce785 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:07.608098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 632/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:07.614208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:07.708312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:07.718223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df64b-d2ae-4406-835a-a4d7f8093357 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:07.751491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495124c-ac78-4a73-a6d0-90621c4cdbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:07.752141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495124c-ac78-4a73-a6d0-90621c4cdbb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:07.752458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495124c-ac78-4a73-a6d0-90621c4cdbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:07.752734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495124c-ac78-4a73-a6d0-90621c4cdbb3 None admin] PATH_INFO: `/v3/projects/0a022669dd2f4cbba866b062924c7035/users/d1f02d8a6f8b462094e147547c7a1a2c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:07.754596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495124c-ac78-4a73-a6d0-90621c4cdbb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a022669dd2f4cbba866b062924c7035, user_id=d1f02d8a6f8b462094e147547c7a1a2c, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:07.756046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495124c-ac78-4a73-a6d0-90621c4cdbb3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:07.769193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 641/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 17 19:17:07 2022] PUT /identity/v3/projects/0a022669dd2f4cbba866b062924c7035/users/d1f02d8a6f8b462094e147547c7a1a2c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:17:09.684278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5585-1bac-4db6-b444-ef9a6596ae46 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:09.684841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5585-1bac-4db6-b444-ef9a6596ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:09.684841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe5585-1bac-4db6-b444-ef9a6596ae46 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:09.686150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 633/1274] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:09.691288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:09.691714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:09.691840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:09.710891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:09.712135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:09.780450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 642/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:10.047395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe5585-1bac-4db6-b444-ef9a6596ae46 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:10.150237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe5585-1bac-4db6-b444-ef9a6596ae46 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:10.168891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:10.185786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:10.186403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:10.186682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:10.186955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:10.197824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:17:10.202514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:10.203694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:10.205053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 634/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 17 19:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:10.209876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:10.297102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:10.314392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d96b-ffb0-4645-ba2d-ccafe27b8143 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:10.349536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:10.350138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:10.350416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:10.350685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:10.351397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:10.351689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:10.353102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:10.361035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 643/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 17 19:17:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:10.367178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:10.473927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80455716-7fcf-4678-8190-f0dfa06b9c7b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:10.508808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e5039-b857-4004-8163-857a28476549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:10.509430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e5039-b857-4004-8163-857a28476549 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:10.509706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e5039-b857-4004-8163-857a28476549 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:10.509977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e5039-b857-4004-8163-857a28476549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:10.519980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e5039-b857-4004-8163-857a28476549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:10.521431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e5039-b857-4004-8163-857a28476549 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-689e5039-b857-4004-8163-857a28476549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:17:10.535040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:10.536134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:17:10.537060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:17:10.537060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:10.537060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:10.537060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 635/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:10.542244 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:10.637960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a8b96-c5b1-4fc7-a34f-1d25c86450d2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:10.674077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:10.674675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:10.674948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:10.675212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:10.676038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:10.676365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:10.677718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:10.690440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 644/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:10.696401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e5039-b857-4004-8163-857a28476549 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:10.727273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:10.795444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e5039-b857-4004-8163-857a28476549 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:10.828030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:10.828676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:10.828956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:10.829227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:10.836539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:10.837942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:17:10.848510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:10.849617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:10.850575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 636/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:17:10.856089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:10.859858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:10.956267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed358a-f634-44db-9351-84704af1d2e3 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:10.989266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:10.989872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:10.990148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:10.990417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:10.991136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:10.991434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:10.992921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:11.016045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 645/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 17 19:17:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:11.023798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:11.112438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:11.122584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742602a3-35bf-48be-b15b-adb53b6ce856 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:11.154627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:11.155221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:11.155495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:11.155763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:11.219897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:11.221292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:11.306810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:11.317289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 637/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 17 19:17:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:17:11.324661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:11.388945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:11.430514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbab5d-854e-4e23-9e06-1e3cfacebae6 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:11.463889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:11.464538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:11.464818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:11.465085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:11.474774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:11.476794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:17:11.490820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:11.492530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:17:11.493415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:17:11.493415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:17:11.493415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:11.493415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 646/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:11.498410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:11.595533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716501ce-a476-4abf-8048-8a6c3a871932 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:11.628331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:11.628931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:11.629206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:11.629475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:11.630100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:11.630396 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:11.631819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:11.642672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 638/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 17 19:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:11.648186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:11.745794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bb7f5-39af-496a-b9f2-4fe602faa014 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:11.758965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:11.780077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:11.780734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:11.781016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:11.781288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:11.787698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:11.789866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:17:11.800781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:11.801832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: ERROR keystone.server.flask.application Aug 17 19:17:11.803176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 647/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 17 19:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:11.807756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:11.857596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:11.906853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a6d94-c2a5-4997-a1de-c23406c6b1a3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:11.939422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:11.940017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:11.940326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:11.940604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:11.941290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:11.941595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:11.943010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c08cd-1ac8-48e0-ab10-00ab6b31f01c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:11.954545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 639/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 17 19:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:17:11.961407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:12.058431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b02c-9236-4a27-bad3-8e0759d52bf2 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:12.091628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:12.092218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:12.092527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:12.092794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:12.093505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] RBAC: Adding query filter params (role.id=26fe7cfbf4cc45afa71282a7cf3ac91a, scope.project.id=0a022669dd2f4cbba866b062924c7035, user.id=d1f02d8a6f8b462094e147547c7a1a2c) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:12.093805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:12.095207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3f7f8-09f6-4364-925b-8dc5f9698f5d None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:12.100798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 648/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 17 19:17:11 2022] GET /identity/v3/role_assignments?user.id=d1f02d8a6f8b462094e147547c7a1a2c&scope.project.id=0a022669dd2f4cbba866b062924c7035&role.id=26fe7cfbf4cc45afa71282a7cf3ac91a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:14.035028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6349a-aef1-4fae-a451-52db3d42e3ea None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:14.035470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6349a-aef1-4fae-a451-52db3d42e3ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:14.035581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6349a-aef1-4fae-a451-52db3d42e3ea None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:14.036989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 640/1288] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:14.042773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:14.043200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:14.043324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:14.061479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:14.062682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:14.098499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:14.138543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 649/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:14.409834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6349a-aef1-4fae-a451-52db3d42e3ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:14.531161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6349a-aef1-4fae-a451-52db3d42e3ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:14.541971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:14.565136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:14.565757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:14.566037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:14.566307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:14.566879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:14.568232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:14.577570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:14.578759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:14.580277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 641/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:17:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:14.584954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:14.683308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2e3a-e58f-4d5c-b394-b963d3755c06 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:14.717536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:14.718135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:14.718415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:14.718689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:14.719311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:14.719613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:14.721009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c315-cc6d-4039-9ab1-2a689e1f5802 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:14.725650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 650/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 17 19:17:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:14.731803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:14.831745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1b59c-f9c4-4a52-ae7c-4da0cfec224f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:14.863809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:14.864430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:14.864716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:14.864990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:14.865635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:14.865935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:14.867839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c51ded-fe70-4afe-896f-f32fddb87f83 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:14.872117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 642/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 17 19:17:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:16.744065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38d70d-3302-4938-89c5-a767578bfd39 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:16.744649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38d70d-3302-4938-89c5-a767578bfd39 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:16.744649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38d70d-3302-4938-89c5-a767578bfd39 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:16.746004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 651/1293] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:16.750985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfaaf-e82f-4eaf-b2bd-6f6cee9ae9cd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:16.751380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfaaf-e82f-4eaf-b2bd-6f6cee9ae9cd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:16.751536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfaaf-e82f-4eaf-b2bd-6f6cee9ae9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:16.769816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-766dfaaf-e82f-4eaf-b2bd-6f6cee9ae9cd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:16.770999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-766dfaaf-e82f-4eaf-b2bd-6f6cee9ae9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:16.800967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:16.837771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 643/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:17.107829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38d70d-3302-4938-89c5-a767578bfd39 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:17.138069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:17.206209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38d70d-3302-4938-89c5-a767578bfd39 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:17.239029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e8ec-debf-439b-8aad-d4dd6a45d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:17.239630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e8ec-debf-439b-8aad-d4dd6a45d6af None admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:17.239910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e8ec-debf-439b-8aad-d4dd6a45d6af None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:17.240181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e8ec-debf-439b-8aad-d4dd6a45d6af None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:17.240852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e8ec-debf-439b-8aad-d4dd6a45d6af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:17.242235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e8ec-debf-439b-8aad-d4dd6a45d6af None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:17.256031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 652/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 17 19:17:17 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:17:19.152032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8e1a-806c-4257-a346-9067b48cfee5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:19.152597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8e1a-806c-4257-a346-9067b48cfee5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:19.152597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8e1a-806c-4257-a346-9067b48cfee5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:19.153957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 644/1296] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:19.162172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:19.162567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:19.162726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:19.180512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:19.181691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:19.252150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 653/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:19.534436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8e1a-806c-4257-a346-9067b48cfee5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:19.633917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8e1a-806c-4257-a346-9067b48cfee5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:19.666936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:19.667555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:19.667836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:19.668098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:19.668689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:19.670051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:19.678405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:19.684438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:19.685440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 645/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:17:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:19.686482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:19.703405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:19.780942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f929-6726-4b03-bdc3-d34921b36893 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:19.814170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:19.814706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:19.814981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:19.815251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:19.815868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:19.816166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:19.817535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:19.822457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 654/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 17 19:17:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:19.828610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:19.859879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:19.925916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f287e-480c-4c9a-85a1-4c2ec4c27fc6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:19.958287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:19.958874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:19.959150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:19.959419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:19.960135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] RBAC: Adding query filter params (interface=public, service_id=d109424bca94400fa1fc6a8b378a6d18, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:19.960464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:19.961960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778cb79-9f4b-4dd6-aa40-535449eab0fb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:19.966780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 646/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 17 19:17:19 2022] GET /identity/v3/endpoints?service_id=d109424bca94400fa1fc6a8b378a6d18&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:19.972385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:20.051579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:20.069721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87248-ff82-483a-91b6-42cf64750010 None admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:20.102520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb995f4-3615-45cc-bf3e-185e2b5050fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:20.103106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb995f4-3615-45cc-bf3e-185e2b5050fb None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:20.103381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb995f4-3615-45cc-bf3e-185e2b5050fb None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:20.103650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb995f4-3615-45cc-bf3e-185e2b5050fb None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:20.104266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb995f4-3615-45cc-bf3e-185e2b5050fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:20.105612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb995f4-3615-45cc-bf3e-185e2b5050fb None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:20.112108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 655/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 17 19:17:19 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:17:22.050106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570a35-f42b-42dc-bbdd-dadf42467c46 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.050567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570a35-f42b-42dc-bbdd-dadf42467c46 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.050678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570a35-f42b-42dc-bbdd-dadf42467c46 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.051990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 647/1302] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:22.057319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.057685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.057874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.076218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:22.077435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:22.143338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 656/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:17:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:17:22.410534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570a35-f42b-42dc-bbdd-dadf42467c46 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:22.513611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:22.520523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570a35-f42b-42dc-bbdd-dadf42467c46 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:22.554212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:22.554838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.555117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.555387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.555958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:22.557333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:17:22.565721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:17:22.566908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Aug 17 19:17:22.567908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 648/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 17 19:17:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:17:22.572782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:22.644652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:22.668637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d95878-8a5a-4750-a86b-6b8738bb2c91 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:22.700682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:22.701273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.701549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.701814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] PATH_INFO: `/v3/services` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.702427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:17:22.702724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:22.704067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87743fa-e95d-4d17-ab1d-4985c00b7e4c None admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:22.709218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 657/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 17 19:17:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:17:22.715921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:22.814456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d4bea-4dcf-4d3a-a09b-8b9cbc68c6f4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:22.848641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83805a4b-53f1-4100-9cfb-1f105e041454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:22.849233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805a4b-53f1-4100-9cfb-1f105e041454 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.849513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805a4b-53f1-4100-9cfb-1f105e041454 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.849786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805a4b-53f1-4100-9cfb-1f105e041454 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.850437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83805a4b-53f1-4100-9cfb-1f105e041454 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:22.852349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83805a4b-53f1-4100-9cfb-1f105e041454 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:22.871226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 649/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:17:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:17:32.706321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=30 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:32.866948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:26.611018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4a9c-55bc-4134-9f7d-5f8e001063e1 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:26.611589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4a9c-55bc-4134-9f7d-5f8e001063e1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:26.611589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4a9c-55bc-4134-9f7d-5f8e001063e1 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:26.616860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 658/1307] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:26.618352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a02820-83f2-4acb-b6f8-b8fe457bbf7a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:26.618784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a02820-83f2-4acb-b6f8-b8fe457bbf7a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:26.618987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a02820-83f2-4acb-b6f8-b8fe457bbf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:26.785047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e2a02820-83f2-4acb-b6f8-b8fe457bbf7a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:26.788106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e2a02820-83f2-4acb-b6f8-b8fe457bbf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:26.944144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 650/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:18:27.244399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c39914-6389-4f36-8ec7-dd909b38fc59 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:27.244684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c39914-6389-4f36-8ec7-dd909b38fc59 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:27.245226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c39914-6389-4f36-8ec7-dd909b38fc59 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:27.246692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 659/1309] 10.222.0.62 () {54 vars in 965 bytes} [Wed Aug 17 19:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:27.253240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34068bc-0912-441a-94f0-2cd2252c22be None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:27.253605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34068bc-0912-441a-94f0-2cd2252c22be None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:27.253951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34068bc-0912-441a-94f0-2cd2252c22be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:27.338837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f34068bc-0912-441a-94f0-2cd2252c22be None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:27.340050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f34068bc-0912-441a-94f0-2cd2252c22be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:27.361297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:27.424667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 651/1310] 10.222.0.62 () {58 vars in 1062 bytes} [Wed Aug 17 19:18:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:27.434898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c39914-6389-4f36-8ec7-dd909b38fc59 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:27.436674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-88c39914-6389-4f36-8ec7-dd909b38fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:27.556041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c39914-6389-4f36-8ec7-dd909b38fc59 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:27.638021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:27.639445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:27.639853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:27.640143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:27.641959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:27.699518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:27.759114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:27.760592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25f35-8fb6-4f71-91be-a4d4735b010e service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:27.779608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 660/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:30.064802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a566-11cf-4a5e-b7a3-1de360870c66 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:30.065322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a566-11cf-4a5e-b7a3-1de360870c66 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:30.065402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a566-11cf-4a5e-b7a3-1de360870c66 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:30.068109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 652/1312] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:30.072481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69c19-7edc-4a08-852d-94d2575c5738 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:30.072876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69c19-7edc-4a08-852d-94d2575c5738 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:30.073037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69c19-7edc-4a08-852d-94d2575c5738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:30.148643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8ee69c19-7edc-4a08-852d-94d2575c5738 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:30.149867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8ee69c19-7edc-4a08-852d-94d2575c5738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:30.248183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 661/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:30.530039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792a566-11cf-4a5e-b7a3-1de360870c66 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:30.531663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9792a566-11cf-4a5e-b7a3-1de360870c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:30.640081 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792a566-11cf-4a5e-b7a3-1de360870c66 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:30.716161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:30.719448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:30.720384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:30.721090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:30.721564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:30.723280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:30.840912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:30.842446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399977c-0766-4449-95a8-5d9981915c06 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:30.860906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 653/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:33.125375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3e63-3214-4d13-a270-6ba94fe9e5a8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:33.125925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3e63-3214-4d13-a270-6ba94fe9e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:33.125925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3e63-3214-4d13-a270-6ba94fe9e5a8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:33.127274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 662/1315] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:33.132620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12194-3d32-445e-9f69-bcfd6743ac27 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:33.133059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12194-3d32-445e-9f69-bcfd6743ac27 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:33.133175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12194-3d32-445e-9f69-bcfd6743ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:33.199461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b3e12194-3d32-445e-9f69-bcfd6743ac27 None None] MFA Rules not processed for user `3e105892d77e451cbb329627efbe0bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:33.200730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b3e12194-3d32-445e-9f69-bcfd6743ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:33.253621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:33.298165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 654/1316] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:33.595545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a3e63-3214-4d13-a270-6ba94fe9e5a8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:33.597153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-157a3e63-3214-4d13-a270-6ba94fe9e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:33.608008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:33.701405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a3e63-3214-4d13-a270-6ba94fe9e5a8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:33.774542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:33.775142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:33.775419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:33.775689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:33.777429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:33.839116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:33.890090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:33.891453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d452f3-8cd2-4064-8158-b382d52d29a7 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:33.910142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 663/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:36.421124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cf3c7-fbcf-4e45-b099-5543d763ebd8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:36.421660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cf3c7-fbcf-4e45-b099-5543d763ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:36.421778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cf3c7-fbcf-4e45-b099-5543d763ebd8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:36.423387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 655/1318] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:36.429513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfadde-9f14-4f83-80b9-ecf04b1ba18a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:36.429900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfadde-9f14-4f83-80b9-ecf04b1ba18a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:36.430069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfadde-9f14-4f83-80b9-ecf04b1ba18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:36.499496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-eccfadde-9f14-4f83-80b9-ecf04b1ba18a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:36.500740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-eccfadde-9f14-4f83-80b9-ecf04b1ba18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:36.600789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 664/1319] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:36.955043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cf3c7-fbcf-4e45-b099-5543d763ebd8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:36.956886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-930cf3c7-fbcf-4e45-b099-5543d763ebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:37.081566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cf3c7-fbcf-4e45-b099-5543d763ebd8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:37.167781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:37.168044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:37.168330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:37.168605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:37.170243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:37.178640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:37.297174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:37.298611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8475ecf-46e4-4044-9c95-13987a76a6fe service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:37.318493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 656/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:40.018062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4bea-0d29-46ac-a53a-e99f1733c7e9 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:40.018511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4bea-0d29-46ac-a53a-e99f1733c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:40.018611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4bea-0d29-46ac-a53a-e99f1733c7e9 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:40.019941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 665/1321] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:40.025174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d865e8-dd58-42a3-ba47-b9aed57d6c4d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:40.025582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d865e8-dd58-42a3-ba47-b9aed57d6c4d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:40.025714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d865e8-dd58-42a3-ba47-b9aed57d6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:40.090844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e9d865e8-dd58-42a3-ba47-b9aed57d6c4d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:40.092101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9d865e8-dd58-42a3-ba47-b9aed57d6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:40.149897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:40.192872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 657/1322] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:40.483746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4bea-0d29-46ac-a53a-e99f1733c7e9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:40.485384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-156b4bea-0d29-46ac-a53a-e99f1733c7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:40.506093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:40.591144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4bea-0d29-46ac-a53a-e99f1733c7e9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:40.666356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:40.666966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:40.667248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:40.667528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:40.669142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:40.739251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:40.778226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:40.779664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde622b-7beb-446e-9b22-7e86eb903e99 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:40.797939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 666/1323] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:42.792842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02d80-1e6f-4abc-9866-d89751daa94a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:42.793394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02d80-1e6f-4abc-9866-d89751daa94a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:42.793501 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02d80-1e6f-4abc-9866-d89751daa94a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:42.794815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 658/1324] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:42.800107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ab1c2-d26c-4139-9a1a-6b30803eb054 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:42.800578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ab1c2-d26c-4139-9a1a-6b30803eb054 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:42.800833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ab1c2-d26c-4139-9a1a-6b30803eb054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:42.866603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b52ab1c2-d26c-4139-9a1a-6b30803eb054 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:42.867802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b52ab1c2-d26c-4139-9a1a-6b30803eb054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:42.962656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 667/1325] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:43.263485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31d1c5-81c4-44b0-b5fa-1dd89cc7a3e3 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:43.263773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31d1c5-81c4-44b0-b5fa-1dd89cc7a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:43.264053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31d1c5-81c4-44b0-b5fa-1dd89cc7a3e3 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:43.265513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 659/1326] 10.222.0.62 () {54 vars in 965 bytes} [Wed Aug 17 19:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:43.272262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530aa5-5325-44c8-ba57-0f84bddde50c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:43.272635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530aa5-5325-44c8-ba57-0f84bddde50c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:43.272970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530aa5-5325-44c8-ba57-0f84bddde50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:43.305240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:43.350143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d7530aa5-5325-44c8-ba57-0f84bddde50c None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:43.351340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d7530aa5-5325-44c8-ba57-0f84bddde50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:43.427909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 668/1327] 10.222.0.62 () {58 vars in 1062 bytes} [Wed Aug 17 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:18:43.437073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31d1c5-81c4-44b0-b5fa-1dd89cc7a3e3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:43.438652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a31d1c5-81c4-44b0-b5fa-1dd89cc7a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:43.542705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31d1c5-81c4-44b0-b5fa-1dd89cc7a3e3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:43.614358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:43.614962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:43.615239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:43.615510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:43.617131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:43.633517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:43.726140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:43.727593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8011b07-3411-4d1e-a80f-d3dbb3d6fe16 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:43.745801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 660/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:46.013687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3af91-86bd-4954-a453-6cebff1addbf None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:46.014217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3af91-86bd-4954-a453-6cebff1addbf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:46.014305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3af91-86bd-4954-a453-6cebff1addbf None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:46.015795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 669/1329] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:46.021911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b3936-eaae-4eea-abda-7302cc216d24 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:46.022369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b3936-eaae-4eea-abda-7302cc216d24 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:46.022723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b3936-eaae-4eea-abda-7302cc216d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:46.095263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-185b3936-eaae-4eea-abda-7302cc216d24 None None] MFA Rules not processed for user `3e105892d77e451cbb329627efbe0bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:46.096492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-185b3936-eaae-4eea-abda-7302cc216d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:46.162807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:46.197909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 661/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:18:46.485619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3af91-86bd-4954-a453-6cebff1addbf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:46.487146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-66f3af91-86bd-4954-a453-6cebff1addbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:46.601806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3af91-86bd-4954-a453-6cebff1addbf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:46.633384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:46.694458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:46.695065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:46.695340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:46.695606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:46.697246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:46.811230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:46.812702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb60be2-c70d-4baf-b59e-60c8fcc4aa02 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:46.831670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 670/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:49.009007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d5647-6ad0-44f9-89ed-2fb7278b7570 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:49.009535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d5647-6ad0-44f9-89ed-2fb7278b7570 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:49.009632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d5647-6ad0-44f9-89ed-2fb7278b7570 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:49.010982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 662/1332] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:49.016323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158710-2f9c-45e9-b03c-f3c38e84320b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:49.016743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158710-2f9c-45e9-b03c-f3c38e84320b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:49.016879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158710-2f9c-45e9-b03c-f3c38e84320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:49.079242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:49.083059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-3e158710-2f9c-45e9-b03c-f3c38e84320b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:49.084778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3e158710-2f9c-45e9-b03c-f3c38e84320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:49.180069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 671/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:49.460111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d5647-6ad0-44f9-89ed-2fb7278b7570 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:49.461658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-586d5647-6ad0-44f9-89ed-2fb7278b7570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:49.562881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d5647-6ad0-44f9-89ed-2fb7278b7570 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:49.634633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:49.635232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:49.635509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:49.635771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:49.637371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:49.664283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:49.744823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:49.746175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68041db9-887e-4fb4-bfdb-28632b099d7c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:49.764582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 663/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:51.759592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5097-8115-4177-90ca-4d4a20502a0d None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:51.760128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5097-8115-4177-90ca-4d4a20502a0d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:51.760128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5097-8115-4177-90ca-4d4a20502a0d None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:51.761530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 672/1335] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:51.766778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e23e-9ffd-4915-aef2-f8f0068b8e37 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:51.767227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e23e-9ffd-4915-aef2-f8f0068b8e37 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:51.767340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e23e-9ffd-4915-aef2-f8f0068b8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:51.836128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b450e23e-9ffd-4915-aef2-f8f0068b8e37 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:51.837370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b450e23e-9ffd-4915-aef2-f8f0068b8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:51.909671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:51.934255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 664/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:52.222914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5097-8115-4177-90ca-4d4a20502a0d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:52.224707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-83ec5097-8115-4177-90ca-4d4a20502a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:52.329073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5097-8115-4177-90ca-4d4a20502a0d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:52.363186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:52.407654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:52.408283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:52.408566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:52.408837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:52.410535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:52.518599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:52.520137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c608e06-1819-4ded-8eba-f1f09a087e73 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:52.538317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 673/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:54.810854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9cac-7182-41f5-b25c-982623d7ca54 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:54.811426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9cac-7182-41f5-b25c-982623d7ca54 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:54.811426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb9cac-7182-41f5-b25c-982623d7ca54 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:54.812785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 665/1338] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:54.818336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675048-38da-4706-83ba-7823aa945144 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:54.818756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675048-38da-4706-83ba-7823aa945144 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:54.818876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675048-38da-4706-83ba-7823aa945144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:54.884292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a3675048-38da-4706-83ba-7823aa945144 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:54.885495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a3675048-38da-4706-83ba-7823aa945144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:54.893576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:54.982526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 674/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:55.263109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb9cac-7182-41f5-b25c-982623d7ca54 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:55.264712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7bcb9cac-7182-41f5-b25c-982623d7ca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:55.366666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb9cac-7182-41f5-b25c-982623d7ca54 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:55.442270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:55.443037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:55.443359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:55.443849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:55.445903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:55.486246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:55.558168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:55.559590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f2a6-00cf-4342-a71c-55d8d48189bf service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:55.577440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 666/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:59.408511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604675-9a5d-4866-99a6-9ebe85b520a7 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:59.408988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604675-9a5d-4866-99a6-9ebe85b520a7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:59.409095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604675-9a5d-4866-99a6-9ebe85b520a7 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:59.411073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 675/1341] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:59.416632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1424aac-a9ae-4418-bbbb-44621500069d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:59.416994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1424aac-a9ae-4418-bbbb-44621500069d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:59.417111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1424aac-a9ae-4418-bbbb-44621500069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:59.486874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e1424aac-a9ae-4418-bbbb-44621500069d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:59.488060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e1424aac-a9ae-4418-bbbb-44621500069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:59.590707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:59.604830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 667/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:59.903246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604675-9a5d-4866-99a6-9ebe85b520a7 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:59.905654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-18604675-9a5d-4866-99a6-9ebe85b520a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:00.020159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604675-9a5d-4866-99a6-9ebe85b520a7 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:00.058852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:00.094894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:00.095499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:00.095778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:00.096049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:00.098296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:00.209919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:00.211277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd834598-281d-4f2e-a8b3-0b179bbdd0b5 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:00.233174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 676/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:03.146648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69684e77-e722-4be6-bf43-b0f6c7848557 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:03.147152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69684e77-e722-4be6-bf43-b0f6c7848557 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:03.147152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69684e77-e722-4be6-bf43-b0f6c7848557 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:03.148476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 668/1344] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:03.153746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44212-2b7e-451c-9409-202ea645f854 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:03.154148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44212-2b7e-451c-9409-202ea645f854 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:03.154296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44212-2b7e-451c-9409-202ea645f854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:03.220016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-92f44212-2b7e-451c-9409-202ea645f854 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:03.221242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-92f44212-2b7e-451c-9409-202ea645f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:03.239734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:03.320638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 677/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:03.610702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69684e77-e722-4be6-bf43-b0f6c7848557 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:03.612264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-69684e77-e722-4be6-bf43-b0f6c7848557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:03.720384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69684e77-e722-4be6-bf43-b0f6c7848557 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:03.796187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:03.796825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:03.797163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:03.797443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:03.799035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:03.849115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:03.914870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:03.916346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7460ec-e5f4-4c0a-b577-c8503784a63e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:03.934519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 669/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:08.127553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d294-fc46-4c9a-82e7-97ea901ccccb None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:08.128097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d294-fc46-4c9a-82e7-97ea901ccccb None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:08.128097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d294-fc46-4c9a-82e7-97ea901ccccb None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:08.132469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 678/1347] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:08.135567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e5a00-d7e2-4439-bfdf-487b6c15431c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:08.136020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e5a00-d7e2-4439-bfdf-487b6c15431c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:08.136127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e5a00-d7e2-4439-bfdf-487b6c15431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:08.219782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-321e5a00-d7e2-4439-bfdf-487b6c15431c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:08.221314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-321e5a00-d7e2-4439-bfdf-487b6c15431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:08.341247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:08.344183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 670/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:08.643953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d294-fc46-4c9a-82e7-97ea901ccccb None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:08.646304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3843d294-fc46-4c9a-82e7-97ea901ccccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:08.757392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d294-fc46-4c9a-82e7-97ea901ccccb None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:08.805573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:08.832008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:08.832650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:08.832927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:08.833195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:08.834796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:08.942154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:08.943598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c32c02-a521-4458-8571-2a924363ed91 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:08.961862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 679/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:13.862386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e99d-a057-4d88-a42a-821397cde503 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:13.863522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e99d-a057-4d88-a42a-821397cde503 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:13.863708 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e99d-a057-4d88-a42a-821397cde503 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:13.866021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 671/1350] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:13.870391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc577-be19-49f0-9b35-a9c5b0f039dc None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:13.870838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc577-be19-49f0-9b35-a9c5b0f039dc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:13.872483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bc577-be19-49f0-9b35-a9c5b0f039dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:13.959023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b69bc577-be19-49f0-9b35-a9c5b0f039dc None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:13.960226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b69bc577-be19-49f0-9b35-a9c5b0f039dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:14.008783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:14.133645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 680/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:18.265573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5d439-6add-4a36-ae7d-ffe82f6ef7b5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:18.266062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5d439-6add-4a36-ae7d-ffe82f6ef7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:18.266062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5d439-6add-4a36-ae7d-ffe82f6ef7b5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:18.267371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 672/1352] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:18.273107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cb44d-fe83-4ba0-8c48-c12881404d5a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:18.273581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cb44d-fe83-4ba0-8c48-c12881404d5a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:18.273661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cb44d-fe83-4ba0-8c48-c12881404d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:18.355246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-846cb44d-fe83-4ba0-8c48-c12881404d5a None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:18.356957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-846cb44d-fe83-4ba0-8c48-c12881404d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:18.434861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:18.473931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 681/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:19:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:20.091377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965818-685f-4a5b-90c1-a76fb092d605 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:20.091931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965818-685f-4a5b-90c1-a76fb092d605 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:20.091931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4965818-685f-4a5b-90c1-a76fb092d605 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:20.093294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 673/1354] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:20.098638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafad887-c776-49a9-8f66-091c65c2736e None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:20.099024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafad887-c776-49a9-8f66-091c65c2736e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:20.099227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafad887-c776-49a9-8f66-091c65c2736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:20.175529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-aafad887-c776-49a9-8f66-091c65c2736e None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:20.176993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-aafad887-c776-49a9-8f66-091c65c2736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:20.283332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 682/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:23.507777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72270498-14de-4306-8ee2-b7354a318127 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:23.508350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72270498-14de-4306-8ee2-b7354a318127 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:23.508350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72270498-14de-4306-8ee2-b7354a318127 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:23.509696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 674/1356] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:23.514752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e90d-b4de-446e-9dac-7d11838f7405 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:23.515153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e90d-b4de-446e-9dac-7d11838f7405 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:23.515317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e90d-b4de-446e-9dac-7d11838f7405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:23.553941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:23.597830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b546e90d-b4de-446e-9dac-7d11838f7405 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:23.599057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b546e90d-b4de-446e-9dac-7d11838f7405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:23.729195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 683/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:24.036067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc20cc8-5d2f-4f4a-942c-eabf1f34e2c7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:24.036393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc20cc8-5d2f-4f4a-942c-eabf1f34e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:24.036700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc20cc8-5d2f-4f4a-942c-eabf1f34e2c7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:24.038045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 675/1358] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 17 19:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:24.046257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4940-7b9a-4bea-955a-f303fefda294 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:24.046967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4940-7b9a-4bea-955a-f303fefda294 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:24.047292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4940-7b9a-4bea-955a-f303fefda294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:24.133947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-05cf4940-7b9a-4bea-955a-f303fefda294 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:24.135185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-05cf4940-7b9a-4bea-955a-f303fefda294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:24.187270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:24.260113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 684/1359] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 17 19:19:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:24.267776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc20cc8-5d2f-4f4a-942c-eabf1f34e2c7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:24.270229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fbc20cc8-5d2f-4f4a-942c-eabf1f34e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:24.426048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc20cc8-5d2f-4f4a-942c-eabf1f34e2c7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:24.506139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:24.548197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:24.548950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:24.549170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:24.549429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:24.551669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:24.647357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:24.649818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5398e67-b96f-4469-9162-ae72d40b0710 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:24.670942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 676/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:26.805662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c2c2-b101-49cf-b464-e170ed00b849 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:26.806208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c2c2-b101-49cf-b464-e170ed00b849 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:26.806208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912c2c2-b101-49cf-b464-e170ed00b849 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:26.807705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 685/1361] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:26.812690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28991bdb-2ac1-4d87-9743-57de99db87c3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:26.813073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28991bdb-2ac1-4d87-9743-57de99db87c3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:26.813237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28991bdb-2ac1-4d87-9743-57de99db87c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:26.880302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-28991bdb-2ac1-4d87-9743-57de99db87c3 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:26.881508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-28991bdb-2ac1-4d87-9743-57de99db87c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:26.925825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:27.004362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 677/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:27.303063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c2c2-b101-49cf-b464-e170ed00b849 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:27.304597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2912c2c2-b101-49cf-b464-e170ed00b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:27.495210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912c2c2-b101-49cf-b464-e170ed00b849 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:27.505082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:27.614239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:27.614844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:27.615120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:27.615388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:27.617036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:27.709824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:27.711409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33e0de-cdc8-4e57-9ddb-a40fbba83d1c service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:27.730132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 686/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:30.048770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9124c-6d74-48cf-bf70-b565f1eb3d5d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:30.049269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9124c-6d74-48cf-bf70-b565f1eb3d5d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:30.049361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9124c-6d74-48cf-bf70-b565f1eb3d5d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:30.050820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 678/1364] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:30.056336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0cb4b-ab67-456b-941f-afc591c2a5f9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:30.056825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0cb4b-ab67-456b-941f-afc591c2a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:30.057041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0cb4b-ab67-456b-941f-afc591c2a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:30.073190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:30.149142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f2c0cb4b-ab67-456b-941f-afc591c2a5f9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:30.151042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f2c0cb4b-ab67-456b-941f-afc591c2a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:30.271391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 687/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:30.575467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2914-beff-42dd-b226-d1f5cfef0d8d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:30.576015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2914-beff-42dd-b226-d1f5cfef0d8d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:30.576728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2914-beff-42dd-b226-d1f5cfef0d8d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:30.578977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 679/1366] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 17 19:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:30.586796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c8f6-1f2a-4ebe-9a60-5b1d89865ed1 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:30.587341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c8f6-1f2a-4ebe-9a60-5b1d89865ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:30.587617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c8f6-1f2a-4ebe-9a60-5b1d89865ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:30.665556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-3200c8f6-1f2a-4ebe-9a60-5b1d89865ed1 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:30.666755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3200c8f6-1f2a-4ebe-9a60-5b1d89865ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:30.703834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:30.794597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 688/1367] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 17 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:30.804277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2914-beff-42dd-b226-d1f5cfef0d8d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:30.806265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fb5b2914-beff-42dd-b226-d1f5cfef0d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:30.968639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2914-beff-42dd-b226-d1f5cfef0d8d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:30.995508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:31.108144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:31.109250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:31.109653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:31.110029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:31.112058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:31.209707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:31.211383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c7c6b-9b3e-4f09-b213-6b86368c1abf service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:31.230744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 680/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:31.857704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cec2a-fddd-4209-b10c-8c7ad3b2ab06 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:31.858247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cec2a-fddd-4209-b10c-8c7ad3b2ab06 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:31.858247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cec2a-fddd-4209-b10c-8c7ad3b2ab06 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:31.859746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 689/1369] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:31.865295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2f94-6756-4293-b939-d8afb6f5e0be None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:31.865584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2f94-6756-4293-b939-d8afb6f5e0be None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:31.865858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f2f94-6756-4293-b939-d8afb6f5e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:31.897904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:31.937224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-457f2f94-6756-4293-b939-d8afb6f5e0be None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:31.938785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-457f2f94-6756-4293-b939-d8afb6f5e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:32.055236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 681/1370] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:32.646306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d0be-82ed-4fac-b2b7-027a679a3eb6 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:32.646798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d0be-82ed-4fac-b2b7-027a679a3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:32.647349 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d0be-82ed-4fac-b2b7-027a679a3eb6 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:32.649141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 690/1371] 10.222.0.62 () {54 vars in 964 bytes} [Wed Aug 17 19:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:32.655348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520de39-3e11-4630-ba68-5eb9ed19500b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:32.655872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520de39-3e11-4630-ba68-5eb9ed19500b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:32.656046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520de39-3e11-4630-ba68-5eb9ed19500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:32.745666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3520de39-3e11-4630-ba68-5eb9ed19500b None None] MFA Rules not processed for user `f26c0d36d3054f098c05b3cdb93853b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:32.746886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3520de39-3e11-4630-ba68-5eb9ed19500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:32.803163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:32.835743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 682/1372] 10.222.0.62 () {58 vars in 1061 bytes} [Wed Aug 17 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:32.843290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d0be-82ed-4fac-b2b7-027a679a3eb6 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:32.844831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1186d0be-82ed-4fac-b2b7-027a679a3eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:32.966175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d0be-82ed-4fac-b2b7-027a679a3eb6 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:33.020877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:33.061689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:33.062311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:33.062593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:33.062866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:33.064869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:33.226673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa80b-db69-4585-9511-c525a90d7344 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:33.227083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa80b-db69-4585-9511-c525a90d7344 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:33.227474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa80b-db69-4585-9511-c525a90d7344 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:33.229681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 683/1373] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:33.235146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814dd9-215d-4243-ad5a-a87d1e7c07ca None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:33.235690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814dd9-215d-4243-ad5a-a87d1e7c07ca None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:33.235956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:33.236129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a814dd9-215d-4243-ad5a-a87d1e7c07ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:33.237612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:33.260603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 691/1374] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:33.316387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0a814dd9-215d-4243-ad5a-a87d1e7c07ca None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:33.317917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0a814dd9-215d-4243-ad5a-a87d1e7c07ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:33.428290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 684/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:19:33.714122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:33.715406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:33.782603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:33.817154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980aadc-bfdf-4498-a455-968e89287db1 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:33.934698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:33.935316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:33.935601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:33.935876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:33.937532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:34.037352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:34.048106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:34.050435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc19209-5367-4ab7-9153-2698350f203b service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:34.068939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 692/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:36.040390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e810d-9441-4385-9c69-275d850166b0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:36.040842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e810d-9441-4385-9c69-275d850166b0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:36.040960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e810d-9441-4385-9c69-275d850166b0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:36.042341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 685/1377] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:36.047544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844f80c-8592-49fb-9f08-04bd36c6e56d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:36.048348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844f80c-8592-49fb-9f08-04bd36c6e56d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:36.048631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844f80c-8592-49fb-9f08-04bd36c6e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:36.116445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d844f80c-8592-49fb-9f08-04bd36c6e56d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:36.117650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d844f80c-8592-49fb-9f08-04bd36c6e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:36.219263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 693/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:36.515463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e810d-9441-4385-9c69-275d850166b0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:36.517042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b73e810d-9441-4385-9c69-275d850166b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:36.577994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:36.686315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e810d-9441-4385-9c69-275d850166b0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:36.863198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:36.863882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:36.864277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:36.864666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:36.866657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:36.896196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:36.997922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:36.999781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202fa12-2863-47c3-a690-219ecdbfabe1 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:37.023251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 686/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:39.045053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f8ea-efe4-460a-a4c9-6ef81202d9c5 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:39.045583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f8ea-efe4-460a-a4c9-6ef81202d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:39.045583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f8ea-efe4-460a-a4c9-6ef81202d9c5 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:39.047155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 694/1380] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:39.053210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716b23-1bcc-43a7-b0f6-86764af9c160 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:39.053643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716b23-1bcc-43a7-b0f6-86764af9c160 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:39.053753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716b23-1bcc-43a7-b0f6-86764af9c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:39.133468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-28716b23-1bcc-43a7-b0f6-86764af9c160 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:39.134676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-28716b23-1bcc-43a7-b0f6-86764af9c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:39.226727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:39.240694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 687/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:39.535872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f8ea-efe4-460a-a4c9-6ef81202d9c5 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:39.537600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6281f8ea-efe4-460a-a4c9-6ef81202d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:39.602913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:39.708191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f8ea-efe4-460a-a4c9-6ef81202d9c5 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:39.845484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:39.846257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:39.847123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:39.847401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:39.849069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:39.870865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:39.946847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:39.948714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4b72-0769-4e86-b414-26bace693ad7 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:39.970056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 695/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:41.967427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ede86b-20ef-4e22-843e-5a81dc4bfb5b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:41.968080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ede86b-20ef-4e22-843e-5a81dc4bfb5b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:41.968080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ede86b-20ef-4e22-843e-5a81dc4bfb5b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:41.969380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 688/1383] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:41.975421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275ef2-5496-4ce4-8863-cd63f7858980 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:41.975942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275ef2-5496-4ce4-8863-cd63f7858980 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:41.976134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275ef2-5496-4ce4-8863-cd63f7858980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:42.053384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-3b275ef2-5496-4ce4-8863-cd63f7858980 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:42.054911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3b275ef2-5496-4ce4-8863-cd63f7858980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:42.156203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:42.160591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 696/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:42.531568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ede86b-20ef-4e22-843e-5a81dc4bfb5b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:42.533588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-57ede86b-20ef-4e22-843e-5a81dc4bfb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:42.701466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ede86b-20ef-4e22-843e-5a81dc4bfb5b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:42.768945 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:42.820137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:42.820785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:42.821065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:42.821337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:42.822939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:42.921821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:42.923893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee47d08-1ca4-40e6-89c6-5a4bd41a94e6 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:42.947440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 689/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:45.279625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a580f-2d3f-457c-a1f6-071188aa5746 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:45.280171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a580f-2d3f-457c-a1f6-071188aa5746 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:45.280318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a580f-2d3f-457c-a1f6-071188aa5746 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:45.281729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 697/1386] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:45.287566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09f25-41af-405d-855d-d3ebe9ffff20 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:45.288003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09f25-41af-405d-855d-d3ebe9ffff20 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:45.288270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09f25-41af-405d-855d-d3ebe9ffff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:45.360574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-05b09f25-41af-405d-855d-d3ebe9ffff20 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:45.361939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-05b09f25-41af-405d-855d-d3ebe9ffff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:45.389257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:45.464933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 690/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:45.783917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a580f-2d3f-457c-a1f6-071188aa5746 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:45.785742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ac2a580f-2d3f-457c-a1f6-071188aa5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:45.945664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a580f-2d3f-457c-a1f6-071188aa5746 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:46.019087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:46.068315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:46.068999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:46.069276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:46.069545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:46.071190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:46.159343 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:46.161009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565537d-1216-4583-bb8a-4b0f705e829c service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:46.179661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 698/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:19:48.165709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402bbb-b61b-4ebe-8058-617c6e29a14e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:48.166257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402bbb-b61b-4ebe-8058-617c6e29a14e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:48.166257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402bbb-b61b-4ebe-8058-617c6e29a14e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:48.167678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 691/1389] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:48.173248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0812-ecf3-4373-8f59-a5c2dd6a5212 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:48.173686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0812-ecf3-4373-8f59-a5c2dd6a5212 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:48.173934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0812-ecf3-4373-8f59-a5c2dd6a5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:48.244314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f04f0812-ecf3-4373-8f59-a5c2dd6a5212 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:48.245583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f04f0812-ecf3-4373-8f59-a5c2dd6a5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:48.281345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:48.344941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 699/1390] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:48.483649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e519-9078-4289-8246-44871ad197b1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:48.483988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e519-9078-4289-8246-44871ad197b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:48.484291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e519-9078-4289-8246-44871ad197b1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:48.485671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 692/1391] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:48.491623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e9bc7-2771-45e5-8822-fb2f4d640f45 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:48.491910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e9bc7-2771-45e5-8822-fb2f4d640f45 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:48.492185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e9bc7-2771-45e5-8822-fb2f4d640f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:48.650125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969e519-9078-4289-8246-44871ad197b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:48.651678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c969e519-9078-4289-8246-44871ad197b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:48.679299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-606e9bc7-2771-45e5-8822-fb2f4d640f45 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:48.680556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-606e9bc7-2771-45e5-8822-fb2f4d640f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:48.781564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 700/1392] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:48.802120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969e519-9078-4289-8246-44871ad197b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:48.811252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:48.918266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:48.918782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:48.919060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:48.919331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:48.920970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:49.025051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:49.026745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c22aa-1709-4dc5-85cc-c8c2814b4776 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:49.045441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 693/1393] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:19:49.087517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0a551-56cf-4a97-aff6-cc0545df128b None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:49.087807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0a551-56cf-4a97-aff6-cc0545df128b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:49.088082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0a551-56cf-4a97-aff6-cc0545df128b None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:49.089475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 701/1394] 10.222.0.62 () {54 vars in 967 bytes} [Wed Aug 17 19:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:49.094516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca69-e74c-4d47-8bb9-3cd5fa78a59e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:49.094974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca69-e74c-4d47-8bb9-3cd5fa78a59e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:49.095254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aca69-e74c-4d47-8bb9-3cd5fa78a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:49.113367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:49.187558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-973aca69-e74c-4d47-8bb9-3cd5fa78a59e None None] MFA Rules not processed for user `11289ffa17db4fe3b3c4b5ad034a4dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:49.188797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-973aca69-e74c-4d47-8bb9-3cd5fa78a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:49.271296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 694/1395] 10.222.0.62 () {58 vars in 1064 bytes} [Wed Aug 17 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:49.279114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0a551-56cf-4a97-aff6-cc0545df128b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:49.280651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2ba0a551-56cf-4a97-aff6-cc0545df128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:49.299074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:49.389031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0a551-56cf-4a97-aff6-cc0545df128b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:49.463804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:49.464358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:49.464634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:49.464902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:49.466490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:49.535325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:49.576126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:49.577592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9057-6339-4714-b0c4-78fe4f972ca8 service glance] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:49.596106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 702/1396] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:50.351159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c461-eb25-4c98-b97f-34e32b1ff853 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:50.351855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c461-eb25-4c98-b97f-34e32b1ff853 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:50.351855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c461-eb25-4c98-b97f-34e32b1ff853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:50.423210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-49c8c461-eb25-4c98-b97f-34e32b1ff853 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:50.425500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-49c8c461-eb25-4c98-b97f-34e32b1ff853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:50.483989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:50.519085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 695/1397] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:19:50.568461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ffd0-5da3-46da-8360-30df0474e3cd None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:50.569004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ffd0-5da3-46da-8360-30df0474e3cd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:50.569004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ffd0-5da3-46da-8360-30df0474e3cd None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:50.570443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 703/1398] 10.222.0.62 () {54 vars in 943 bytes} [Wed Aug 17 19:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:50.576861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf42291-e1bc-4ed2-af5c-080dc0cc1938 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:50.577216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf42291-e1bc-4ed2-af5c-080dc0cc1938 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:50.577549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf42291-e1bc-4ed2-af5c-080dc0cc1938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:50.653677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3cf42291-e1bc-4ed2-af5c-080dc0cc1938 None None] MFA Rules not processed for user `a9e4244f9ac349feb38fce19062e7c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:50.654791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3cf42291-e1bc-4ed2-af5c-080dc0cc1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:50.761792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 696/1399] 10.222.0.62 () {58 vars in 1040 bytes} [Wed Aug 17 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:50.773263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07ffd0-5da3-46da-8360-30df0474e3cd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:50.775825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fc07ffd0-5da3-46da-8360-30df0474e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:50.913613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07ffd0-5da3-46da-8360-30df0474e3cd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:50.951136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:51.020618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:51.021222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:51.021498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:51.021761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:51.023359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:51.072063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81426cf-7f4b-410a-a273-4cc09cb328d6 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:51.072382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81426cf-7f4b-410a-a273-4cc09cb328d6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:51.072657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81426cf-7f4b-410a-a273-4cc09cb328d6 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:51.073995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 697/1400] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:19:51.078936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a330-2da7-49ea-9482-7141cccc7588 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:51.079224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a330-2da7-49ea-9482-7141cccc7588 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:51.079520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704a330-2da7-49ea-9482-7141cccc7588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:51.110241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:51.111868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:51.117608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:51.120859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 704/1401] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:19:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:19:51.150966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0704a330-2da7-49ea-9482-7141cccc7588 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:51.152393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0704a330-2da7-49ea-9482-7141cccc7588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:51.268874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 698/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:19:51.591059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:51.592395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:51.661163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:51.690286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195f1fc-17cf-45b5-8bbe-171365085920 service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:51.812790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:51.813409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:51.813690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:51.813961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:51.816197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:51.912700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:51.915417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:51.917654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0e835-9239-423c-a4ea-e57b7a8b2743 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:51.936478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 705/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:53.877890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80859-b3df-4a3e-8833-70dc3190190f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:53.878862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80859-b3df-4a3e-8833-70dc3190190f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:53.879172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80859-b3df-4a3e-8833-70dc3190190f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:53.881812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 699/1404] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:53.886348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f80d5-0f56-470c-a6e2-2781e3fe649a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:53.886785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f80d5-0f56-470c-a6e2-2781e3fe649a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:53.886874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f80d5-0f56-470c-a6e2-2781e3fe649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:53.960153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f40f80d5-0f56-470c-a6e2-2781e3fe649a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:53.961404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f40f80d5-0f56-470c-a6e2-2781e3fe649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:54.088414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 706/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:54.381838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80859-b3df-4a3e-8833-70dc3190190f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:54.390331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-48e80859-b3df-4a3e-8833-70dc3190190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:54.525699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:54.581583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80859-b3df-4a3e-8833-70dc3190190f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:54.717218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:54.717743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:54.718028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:54.718297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:54.721179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:54.801069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:54.826059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:54.827809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb313ee-e41f-4c35-bbd4-2287026ddb82 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:54.849681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 700/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:19:56.818633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5e0e-5b19-4405-9172-33cdffcbdd33 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:56.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5e0e-5b19-4405-9172-33cdffcbdd33 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:56.819294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5e0e-5b19-4405-9172-33cdffcbdd33 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:56.820540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 707/1407] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:19:56.825749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2d84-cfa5-4865-a0cb-0de175c40d30 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:56.826520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2d84-cfa5-4865-a0cb-0de175c40d30 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:56.826812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2d84-cfa5-4865-a0cb-0de175c40d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:56.901887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e2fd2d84-cfa5-4865-a0cb-0de175c40d30 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:19:56.903107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e2fd2d84-cfa5-4865-a0cb-0de175c40d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:57.017533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 701/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:19:57.305673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5e0e-5b19-4405-9172-33cdffcbdd33 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:19:57.307172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-917a5e0e-5b19-4405-9172-33cdffcbdd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:57.382654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:57.466478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5e0e-5b19-4405-9172-33cdffcbdd33 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:19:57.597006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:19:57.597536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:19:57.597814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:19:57.598087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:19:57.599697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:19:57.630934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:19:57.700236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:19:57.702286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6496-a505-481e-bbe0-df4875f751db service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:19:57.722590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 708/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:07.015757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=79 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:07.719183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=33 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:13.452798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8e91-e201-48e6-b57d-029e52de69e0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:13.453338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8e91-e201-48e6-b57d-029e52de69e0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:13.453338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8e91-e201-48e6-b57d-029e52de69e0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:13.454742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 702/1410] 10.222.0.62 () {54 vars in 918 bytes} [Wed Aug 17 19:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:13.460019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2584a-6b87-444a-81a1-c34757baf599 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:13.460455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2584a-6b87-444a-81a1-c34757baf599 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:13.460602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2584a-6b87-444a-81a1-c34757baf599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:13.537385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d8a2584a-6b87-444a-81a1-c34757baf599 None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:13.538608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d8a2584a-6b87-444a-81a1-c34757baf599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:13.644189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 709/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 17 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:13.658903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec4bb-9aff-4b90-be40-ce5bcfa670ad None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:13.659182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec4bb-9aff-4b90-be40-ce5bcfa670ad None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:13.659452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec4bb-9aff-4b90-be40-ce5bcfa670ad None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:13.660807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 703/1412] 10.222.0.62 () {54 vars in 918 bytes} [Wed Aug 17 19:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:13.665341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41eff7-015a-4b28-b1ea-f79e1dd60897 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:13.665651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41eff7-015a-4b28-b1ea-f79e1dd60897 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:13.665927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41eff7-015a-4b28-b1ea-f79e1dd60897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:13.737681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:13.740309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fd41eff7-015a-4b28-b1ea-f79e1dd60897 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:13.742293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fd41eff7-015a-4b28-b1ea-f79e1dd60897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:13.855988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 710/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 17 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:16.238177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7328705-1d96-4c0d-8fa5-0faf68139823 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:16.238742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7328705-1d96-4c0d-8fa5-0faf68139823 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:16.238742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7328705-1d96-4c0d-8fa5-0faf68139823 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:16.240097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:16.245478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffdd05-421a-4e55-9b3d-06834afabdb5 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:16.245878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffdd05-421a-4e55-9b3d-06834afabdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:16.246033 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffdd05-421a-4e55-9b3d-06834afabdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:16.311600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9fffdd05-421a-4e55-9b3d-06834afabdb5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:16.312826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9fffdd05-421a-4e55-9b3d-06834afabdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:16.377966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:16.423364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:16.711463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7328705-1d96-4c0d-8fa5-0faf68139823 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:16.713117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a7328705-1d96-4c0d-8fa5-0faf68139823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:16.860441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7328705-1d96-4c0d-8fa5-0faf68139823 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:16.932304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:16.972684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427be72-8211-47ae-a26d-674847540363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:16.973215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427be72-8211-47ae-a26d-674847540363 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:16.973488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427be72-8211-47ae-a26d-674847540363 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:16.973754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427be72-8211-47ae-a26d-674847540363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:16.975336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8427be72-8211-47ae-a26d-674847540363 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:17.068919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427be72-8211-47ae-a26d-674847540363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:17.071280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427be72-8211-47ae-a26d-674847540363 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:17.091342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 705/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:17.981864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528906c-75c7-48ed-89ca-b46189fbc902 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:17.982417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528906c-75c7-48ed-89ca-b46189fbc902 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:17.982417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528906c-75c7-48ed-89ca-b46189fbc902 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:17.983781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:17.989231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0c03-61ed-4ea5-8959-d0e464ca644a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:17.989659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0c03-61ed-4ea5-8959-d0e464ca644a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:17.989765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0c03-61ed-4ea5-8959-d0e464ca644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:18.065572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-aa8d0c03-61ed-4ea5-8959-d0e464ca644a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:18.066766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aa8d0c03-61ed-4ea5-8959-d0e464ca644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:18.092842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:18.164128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:18.314669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528906c-75c7-48ed-89ca-b46189fbc902 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:18.316226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d528906c-75c7-48ed-89ca-b46189fbc902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:18.477579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528906c-75c7-48ed-89ca-b46189fbc902 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:18.516761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:18.591713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:18.592268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:18.592550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:18.592823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:18.594416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:18.685672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:18.687275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17bc2f-e433-4541-b674-811bd6e391a6 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:18.706775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 713/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:19.613789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689eb8-d424-4f7f-a91e-12ef7c960039 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:19.614327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689eb8-d424-4f7f-a91e-12ef7c960039 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:19.614327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689eb8-d424-4f7f-a91e-12ef7c960039 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:19.615697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:19.620569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cfc4b-be93-4eac-9008-869f96586121 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:19.620994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cfc4b-be93-4eac-9008-869f96586121 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:19.621121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cfc4b-be93-4eac-9008-869f96586121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:19.680944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:19.705332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-1f8cfc4b-be93-4eac-9008-869f96586121 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:19.706803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1f8cfc4b-be93-4eac-9008-869f96586121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:19.815521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:19.971126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689eb8-d424-4f7f-a91e-12ef7c960039 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:19.972825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-01689eb8-d424-4f7f-a91e-12ef7c960039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:20.131098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01689eb8-d424-4f7f-a91e-12ef7c960039 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:20.143512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:20.244044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:20.244594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:20.244872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:20.245136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:20.246791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:20.333586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:20.335155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488487ef-8e56-48b8-9f64-3db95d28bbef service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:20.352601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 708/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:21.235465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163feb2-12c2-42cd-8294-40d5dd98b757 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:21.236149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163feb2-12c2-42cd-8294-40d5dd98b757 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:21.236306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163feb2-12c2-42cd-8294-40d5dd98b757 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:21.237620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:21.242584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef057-d154-45c9-89e9-43e37aff2024 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:21.242988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef057-d154-45c9-89e9-43e37aff2024 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:21.243134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cef057-d154-45c9-89e9-43e37aff2024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:21.263374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:21.319325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-97cef057-d154-45c9-89e9-43e37aff2024 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:21.320552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-97cef057-d154-45c9-89e9-43e37aff2024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:21.418375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:21.583306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163feb2-12c2-42cd-8294-40d5dd98b757 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:21.584855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a163feb2-12c2-42cd-8294-40d5dd98b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:21.693897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:21.731050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163feb2-12c2-42cd-8294-40d5dd98b757 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:21.843459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:21.843988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:21.844292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:21.844568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:21.846837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:21.922539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:21.936976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:21.938562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd6f2e-412a-4185-9d5e-7e5c284aefb6 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:21.957769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 716/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:22.816957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca6841-0e7e-4bf8-b9eb-25dc85781043 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:22.817516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca6841-0e7e-4bf8-b9eb-25dc85781043 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:22.817615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca6841-0e7e-4bf8-b9eb-25dc85781043 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:22.818924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:22.823860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14ad19-0ae5-4987-b640-4ec4f743b9da None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:22.824281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14ad19-0ae5-4987-b640-4ec4f743b9da None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:22.824450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14ad19-0ae5-4987-b640-4ec4f743b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:22.902213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0a14ad19-0ae5-4987-b640-4ec4f743b9da None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:22.903432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0a14ad19-0ae5-4987-b640-4ec4f743b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:23.000290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:23.157149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca6841-0e7e-4bf8-b9eb-25dc85781043 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:23.158644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-13ca6841-0e7e-4bf8-b9eb-25dc85781043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:23.240825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:23.301326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca6841-0e7e-4bf8-b9eb-25dc85781043 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:23.416432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:23.416988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:23.417269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:23.417543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:23.419154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:23.467519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:23.509605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:23.511215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe63e93-823d-4397-b9da-b60432090cec service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:23.533108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 711/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:24.350721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d75afc-c65b-4c10-8991-ffe2d63d2d64 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:24.351271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d75afc-c65b-4c10-8991-ffe2d63d2d64 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:24.351271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d75afc-c65b-4c10-8991-ffe2d63d2d64 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:24.352647 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:24.357674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1ebe-0f9a-4b0c-8d26-0897552d69ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:24.358108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1ebe-0f9a-4b0c-8d26-0897552d69ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:24.358230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1ebe-0f9a-4b0c-8d26-0897552d69ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:24.441117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-13ab1ebe-0f9a-4b0c-8d26-0897552d69ea None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:24.444611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-13ab1ebe-0f9a-4b0c-8d26-0897552d69ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:24.550445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:24.729620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d75afc-c65b-4c10-8991-ffe2d63d2d64 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:24.731053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d2d75afc-c65b-4c10-8991-ffe2d63d2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:24.780688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:24.888288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d75afc-c65b-4c10-8991-ffe2d63d2d64 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:25.002661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:25.003291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:25.003574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:25.003847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:25.005511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:25.012806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:25.099019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:25.100654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689fb6-8a8b-4884-98f3-9192e9bb87cc service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:25.120151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 719/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:25.974012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638d0a9-6e5c-4bd6-b35e-e5f900825608 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:25.974578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638d0a9-6e5c-4bd6-b35e-e5f900825608 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:25.974578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638d0a9-6e5c-4bd6-b35e-e5f900825608 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:25.975916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:25.980890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a0601-0a1c-4587-a104-940ecb20fe5b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:25.981351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a0601-0a1c-4587-a104-940ecb20fe5b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:25.981464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a0601-0a1c-4587-a104-940ecb20fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:26.063258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a50a0601-0a1c-4587-a104-940ecb20fe5b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:26.064548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a50a0601-0a1c-4587-a104-940ecb20fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:26.132975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:26.163783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:26.318855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638d0a9-6e5c-4bd6-b35e-e5f900825608 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:26.320410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3638d0a9-6e5c-4bd6-b35e-e5f900825608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:26.338869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:26.475359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638d0a9-6e5c-4bd6-b35e-e5f900825608 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:26.561256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:26.588262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:26.588831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:26.589111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:26.589385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:26.590980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:26.685457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:26.687191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c51bd4-7410-4040-bb79-f825fedde30e service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:26.710901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 714/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:27.544070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f7a7d-1b1a-4800-9090-ca297fa1fc8c None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:27.544714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f7a7d-1b1a-4800-9090-ca297fa1fc8c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:27.545083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f7a7d-1b1a-4800-9090-ca297fa1fc8c None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:27.547050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:27.554034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd342d9-9e4f-439a-b39d-cc4b20ffe538 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:27.554510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd342d9-9e4f-439a-b39d-cc4b20ffe538 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:27.554616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd342d9-9e4f-439a-b39d-cc4b20ffe538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:27.644635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1dd342d9-9e4f-439a-b39d-cc4b20ffe538 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:27.645837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1dd342d9-9e4f-439a-b39d-cc4b20ffe538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:27.692791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:27.756667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:27.917967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f7a7d-1b1a-4800-9090-ca297fa1fc8c None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:27.919366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-409f7a7d-1b1a-4800-9090-ca297fa1fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:28.080585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f7a7d-1b1a-4800-9090-ca297fa1fc8c None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:28.139669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:28.200745 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:28.201263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:28.201537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:28.201806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:28.203428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:28.304022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:28.307932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570172-6d44-412a-ba96-ef2f0c1ee89f service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:28.330628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 722/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:29.148565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1194a7a-54b9-4ebd-a428-21bba4fe1f39 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:29.149126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1194a7a-54b9-4ebd-a428-21bba4fe1f39 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:29.149126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1194a7a-54b9-4ebd-a428-21bba4fe1f39 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:29.150474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:29.155514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1a576-3216-4d80-8904-5b3b7fcc4ff5 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:29.155971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1a576-3216-4d80-8904-5b3b7fcc4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:29.156077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1a576-3216-4d80-8904-5b3b7fcc4ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:29.245197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d1c1a576-3216-4d80-8904-5b3b7fcc4ff5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:29.246425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d1c1a576-3216-4d80-8904-5b3b7fcc4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:29.248623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:29.343689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:29.497115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1194a7a-54b9-4ebd-a428-21bba4fe1f39 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:29.498631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b1194a7a-54b9-4ebd-a428-21bba4fe1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:29.645573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1194a7a-54b9-4ebd-a428-21bba4fe1f39 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:29.674188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:29.769238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:29.769855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:29.770139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:29.770414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:29.772078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:29.866436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:29.868040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494ebde-51a1-44d9-a361-d4e84cb2eff9 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:29.886464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 717/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:31.815999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a144-896e-4217-8c53-df6ffdd007bf None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:31.816616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a144-896e-4217-8c53-df6ffdd007bf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:31.816616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a144-896e-4217-8c53-df6ffdd007bf None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:31.817918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:31.823271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ec06e-f817-4ee6-b3b1-a2d933f480ac None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:31.823687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ec06e-f817-4ee6-b3b1-a2d933f480ac None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:31.823804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ec06e-f817-4ee6-b3b1-a2d933f480ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:31.867357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:31.894524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c85ec06e-f817-4ee6-b3b1-a2d933f480ac None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:31.895720 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c85ec06e-f817-4ee6-b3b1-a2d933f480ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:31.992481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:32.286157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a144-896e-4217-8c53-df6ffdd007bf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:32.287723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e398a144-896e-4217-8c53-df6ffdd007bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:32.388584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a144-896e-4217-8c53-df6ffdd007bf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:32.421248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:32.464420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:32.465022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:32.465303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:32.465571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:32.467141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:32.573408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:32.574762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf3e91-23b8-4744-b82d-c73fa6d5c4dc service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:32.595636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 725/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:34.700442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6380d-1034-41ea-9c61-94e834bb5e78 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:34.701012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6380d-1034-41ea-9c61-94e834bb5e78 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:34.701012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6380d-1034-41ea-9c61-94e834bb5e78 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:34.702335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:34.708623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42320-7d86-46a5-9eba-c8455d833e3b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:34.709035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42320-7d86-46a5-9eba-c8455d833e3b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:34.709148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c42320-7d86-46a5-9eba-c8455d833e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:34.773942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-38c42320-7d86-46a5-9eba-c8455d833e3b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:34.775127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-38c42320-7d86-46a5-9eba-c8455d833e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:34.787354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:34.869863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:35.156222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6380d-1034-41ea-9c61-94e834bb5e78 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:35.158407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e5c6380d-1034-41ea-9c61-94e834bb5e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:35.260828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6380d-1034-41ea-9c61-94e834bb5e78 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:35.274863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:35.352535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:35.353151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:35.353429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:35.353701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:35.355346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:35.471936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:35.473405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70a7a6-a8d5-43fd-a799-677f0950b7a0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:35.491190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 720/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:37.826737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7af0-a9e7-46cd-9bb4-56ef02eb8eb5 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:37.827279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7af0-a9e7-46cd-9bb4-56ef02eb8eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:37.827731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7af0-a9e7-46cd-9bb4-56ef02eb8eb5 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:37.829729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:37.836689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fde9-6c90-4d24-83a5-ce621661286a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:37.837153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fde9-6c90-4d24-83a5-ce621661286a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:37.837246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fde9-6c90-4d24-83a5-ce621661286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:37.887610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:37.905983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4a95fde9-6c90-4d24-83a5-ce621661286a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:37.907839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4a95fde9-6c90-4d24-83a5-ce621661286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:38.008765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:38.308011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d7af0-a9e7-46cd-9bb4-56ef02eb8eb5 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:38.309578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2c8d7af0-a9e7-46cd-9bb4-56ef02eb8eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:38.428816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d7af0-a9e7-46cd-9bb4-56ef02eb8eb5 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:38.470680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:38.504787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:38.505387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:38.505662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:38.505927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:38.507510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:38.612345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:38.613705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e87be-3f0b-448b-ad4f-2686a5f114d8 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:38.633441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 728/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:40.673780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42550d5f-1d4f-44de-b8b1-1206882ffe85 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:40.674329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42550d5f-1d4f-44de-b8b1-1206882ffe85 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:40.674329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42550d5f-1d4f-44de-b8b1-1206882ffe85 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:40.675672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:40.680978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86336cd5-0899-45f1-9d28-c085b9ef4df8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:40.681409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86336cd5-0899-45f1-9d28-c085b9ef4df8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:40.681562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86336cd5-0899-45f1-9d28-c085b9ef4df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:40.747132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-86336cd5-0899-45f1-9d28-c085b9ef4df8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:40.748426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-86336cd5-0899-45f1-9d28-c085b9ef4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:40.769235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:40.846757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:41.129344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42550d5f-1d4f-44de-b8b1-1206882ffe85 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:41.130903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-42550d5f-1d4f-44de-b8b1-1206882ffe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:41.234812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42550d5f-1d4f-44de-b8b1-1206882ffe85 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:41.256238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:41.309930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:41.310534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:41.310813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:41.311080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:41.312715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:41.426471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:41.427809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ccd9b-c004-42df-bad0-daf4903d0acc service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:41.447231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 723/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:43.414194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378186b7-ce35-4e7c-a05a-67a65f925d78 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:43.414750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378186b7-ce35-4e7c-a05a-67a65f925d78 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:43.414750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378186b7-ce35-4e7c-a05a-67a65f925d78 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:43.416078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:43.421361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12da3d-390d-4d6f-b758-6af15e7c1d74 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:43.421795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12da3d-390d-4d6f-b758-6af15e7c1d74 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:43.421912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12da3d-390d-4d6f-b758-6af15e7c1d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:43.486628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:43.489539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3a12da3d-390d-4d6f-b758-6af15e7c1d74 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:43.491250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3a12da3d-390d-4d6f-b758-6af15e7c1d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:43.587106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:43.888023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378186b7-ce35-4e7c-a05a-67a65f925d78 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:43.889569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-378186b7-ce35-4e7c-a05a-67a65f925d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:43.991982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378186b7-ce35-4e7c-a05a-67a65f925d78 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:44.041269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:44.066897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:44.067508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:44.067786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:44.068056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:44.069697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:44.179350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:44.180748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3065e0a-8cf4-478e-8fd8-1c00068ed39d service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:44.199222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 731/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:46.161662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc569-bdf5-4cc7-a226-70a50e223b22 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:46.162174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc569-bdf5-4cc7-a226-70a50e223b22 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:46.162294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc569-bdf5-4cc7-a226-70a50e223b22 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:46.163552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:46.168847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0a27-dd2f-463a-afa2-f36fc79c2d50 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:46.169255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0a27-dd2f-463a-afa2-f36fc79c2d50 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:46.169367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd0a27-dd2f-463a-afa2-f36fc79c2d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:46.234205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f7dd0a27-dd2f-463a-afa2-f36fc79c2d50 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:46.235541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f7dd0a27-dd2f-463a-afa2-f36fc79c2d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:46.264429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:46.333170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:46.626013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc569-bdf5-4cc7-a226-70a50e223b22 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:46.627586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aa4fc569-bdf5-4cc7-a226-70a50e223b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:46.749763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc569-bdf5-4cc7-a226-70a50e223b22 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:46.777253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:46.822429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:46.823032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:46.823311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:46.823579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:46.825213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:47.062912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:47.064822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5904e1-2c80-4d4a-a17d-e86fe679e82f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:47.083695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 726/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:49.049453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fcee0-6891-4f2b-8076-4d9ab03aacef None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:49.049970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fcee0-6891-4f2b-8076-4d9ab03aacef None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:49.049970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fcee0-6891-4f2b-8076-4d9ab03aacef None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:49.051336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:20:49.056546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03c39-d872-4c3d-b075-0b171d7c4ca2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:49.056977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03c39-d872-4c3d-b075-0b171d7c4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:49.057127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03c39-d872-4c3d-b075-0b171d7c4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:49.121012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-99e03c39-d872-4c3d-b075-0b171d7c4ca2 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:49.122200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-99e03c39-d872-4c3d-b075-0b171d7c4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:49.130753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:49.217480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:20:49.506469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fcee0-6891-4f2b-8076-4d9ab03aacef None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:49.508005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ff1fcee0-6891-4f2b-8076-4d9ab03aacef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:49.609498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fcee0-6891-4f2b-8076-4d9ab03aacef None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:49.668507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:49.686715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:49.687320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:49.687611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:49.688527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:49.690191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:49.805130 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:49.806573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b69af-8c87-4c22-a8f3-db444c6c9283 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:49.825629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 734/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:51.771507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571ec-618d-4ec0-981d-a150caf20aad None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:51.772078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571ec-618d-4ec0-981d-a150caf20aad None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:51.772078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571ec-618d-4ec0-981d-a150caf20aad None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:51.773413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:51.778548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766bd9a-6cd2-46fe-91e6-6a6483449568 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:51.778964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766bd9a-6cd2-46fe-91e6-6a6483449568 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:51.779102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766bd9a-6cd2-46fe-91e6-6a6483449568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:51.844304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8766bd9a-6cd2-46fe-91e6-6a6483449568 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:51.845536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8766bd9a-6cd2-46fe-91e6-6a6483449568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:51.884035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:51.941314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:52.246326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961571ec-618d-4ec0-981d-a150caf20aad None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:52.247893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-961571ec-618d-4ec0-981d-a150caf20aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:52.352166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961571ec-618d-4ec0-981d-a150caf20aad None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:52.388204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:52.430791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:52.431388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:52.431661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:52.431929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:52.433544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:52.546589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:52.548619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a24a8-5094-4880-bfee-591fbb8b57af service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:52.567350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 729/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:54.489278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b62dd4-386c-47b5-b479-e721bae4f880 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:54.489849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b62dd4-386c-47b5-b479-e721bae4f880 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:54.489849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b62dd4-386c-47b5-b479-e721bae4f880 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:54.491247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:54.496670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e417d-2a0d-4c5d-a27a-5e5b7a64df8c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:54.497086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e417d-2a0d-4c5d-a27a-5e5b7a64df8c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:54.497199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e417d-2a0d-4c5d-a27a-5e5b7a64df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:54.562138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4e1e417d-2a0d-4c5d-a27a-5e5b7a64df8c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:54.563448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e1e417d-2a0d-4c5d-a27a-5e5b7a64df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:54.581743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:54.661255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:54.945023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b62dd4-386c-47b5-b479-e721bae4f880 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:54.946636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-38b62dd4-386c-47b5-b479-e721bae4f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:55.054849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b62dd4-386c-47b5-b479-e721bae4f880 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:55.121528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:55.129015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:55.129618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:55.129898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:55.130171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:55.131819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:55.246860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:55.248209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c18e0-e1eb-4e21-901f-c6324452ee70 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:55.267444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 737/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:57.192338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e2b4-d70a-4b0b-8379-85a959353a90 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:57.192911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e2b4-d70a-4b0b-8379-85a959353a90 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:57.192911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e2b4-d70a-4b0b-8379-85a959353a90 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:57.194283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:57.199547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc9ad-f7a2-4bc1-9371-4d3ac78a4729 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:57.199971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc9ad-f7a2-4bc1-9371-4d3ac78a4729 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:57.200084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc9ad-f7a2-4bc1-9371-4d3ac78a4729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:57.264898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c90cc9ad-f7a2-4bc1-9371-4d3ac78a4729 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:57.266807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c90cc9ad-f7a2-4bc1-9371-4d3ac78a4729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:57.313957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:57.363614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:57.662410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e2b4-d70a-4b0b-8379-85a959353a90 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:57.663938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f69e2b4-d70a-4b0b-8379-85a959353a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:57.765205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e2b4-d70a-4b0b-8379-85a959353a90 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:57.811032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:57.836948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:57.837542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:57.837818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:57.838086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:57.839659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:57.945076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:57.946410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a69e8-4c5a-4cd5-a8bc-0e52ef847124 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:57.965678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 732/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:07.361808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=22 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:07.963410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=66 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:17.902935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053cd18-7535-4c5c-8f79-aa0c9a8aadda None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:17.903504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053cd18-7535-4c5c-8f79-aa0c9a8aadda None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:17.903504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053cd18-7535-4c5c-8f79-aa0c9a8aadda None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:17.905038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 739/1471] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:21:17.910870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa88d8-76bb-4c8f-b886-aef0ee18445f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:17.911317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa88d8-76bb-4c8f-b886-aef0ee18445f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:17.911457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa88d8-76bb-4c8f-b886-aef0ee18445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:17.977806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-36fa88d8-76bb-4c8f-b886-aef0ee18445f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:17.979008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-36fa88d8-76bb-4c8f-b886-aef0ee18445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:18.072589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 733/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:18.375954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc540-bb1f-4810-b533-eedbf142e355 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:18.376257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc540-bb1f-4810-b533-eedbf142e355 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:18.376544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc540-bb1f-4810-b533-eedbf142e355 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:18.377889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 740/1473] 10.222.0.62 () {54 vars in 967 bytes} [Wed Aug 17 19:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:18.382653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c93d1-fb7c-46fa-8716-179b34b0a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:18.382967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c93d1-fb7c-46fa-8716-179b34b0a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:18.383238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c93d1-fb7c-46fa-8716-179b34b0a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:18.465074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-956c93d1-fb7c-46fa-8716-179b34b0a9e7 None None] MFA Rules not processed for user `11289ffa17db4fe3b3c4b5ad034a4dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:18.466276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-956c93d1-fb7c-46fa-8716-179b34b0a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:18.486659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:18.542688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 734/1474] 10.222.0.62 () {58 vars in 1064 bytes} [Wed Aug 17 19:21:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:18.551288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fc540-bb1f-4810-b533-eedbf142e355 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:18.552821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e43fc540-bb1f-4810-b533-eedbf142e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:18.654681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fc540-bb1f-4810-b533-eedbf142e355 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:18.726288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:18.726900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:18.727181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:18.727454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:18.729108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:18.783578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:18.848819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:18.850257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f059-0bd5-49e6-bfe5-2674367db694 service glance] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:18.870993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 741/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:20.870434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a123-ef18-4b09-8772-982ff8bae65c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:20.871011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a123-ef18-4b09-8772-982ff8bae65c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:20.871011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a123-ef18-4b09-8772-982ff8bae65c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:20.872398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 735/1476] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:20.877725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10260-8bd3-4e19-97ad-31946958000d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:20.878165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10260-8bd3-4e19-97ad-31946958000d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:20.878282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10260-8bd3-4e19-97ad-31946958000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:20.944608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-19d10260-8bd3-4e19-97ad-31946958000d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:20.945849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-19d10260-8bd3-4e19-97ad-31946958000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:21.041746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 742/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:21.311181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a123-ef18-4b09-8772-982ff8bae65c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:21.313669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f8f7a123-ef18-4b09-8772-982ff8bae65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:21.441839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a123-ef18-4b09-8772-982ff8bae65c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:21.492572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:21.537811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:21.538412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:21.538690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:21.538961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:21.539595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:21.541329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:21:21.541329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:21:21.541329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:21:21.542447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92688f-f92b-4e32-9831-3681fff04af7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:21.561269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 736/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 17 19:21:21 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:21:23.497324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411c62d-2ac4-4099-9866-95f09e0f7686 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:23.497942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411c62d-2ac4-4099-9866-95f09e0f7686 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:23.497942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411c62d-2ac4-4099-9866-95f09e0f7686 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:23.499765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 743/1479] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:23.505060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821598-043b-4916-ad2e-2c7122fbf716 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:23.505499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821598-043b-4916-ad2e-2c7122fbf716 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:23.505643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821598-043b-4916-ad2e-2c7122fbf716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:23.590138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-32821598-043b-4916-ad2e-2c7122fbf716 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:23.591271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-32821598-043b-4916-ad2e-2c7122fbf716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:23.688133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 737/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:23.987577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411c62d-2ac4-4099-9866-95f09e0f7686 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:23.989230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9411c62d-2ac4-4099-9866-95f09e0f7686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:23.999022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:24.135207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411c62d-2ac4-4099-9866-95f09e0f7686 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:24.212005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:24.244284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:24.244828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:24.245102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:24.245369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:24.246930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:24.335459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:24.337092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe09445-5a2b-4769-9545-889e353866cd service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:24.355554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 744/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:21:26.451121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311d48-1db0-4577-8bd3-52859dd56a8f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:26.451702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311d48-1db0-4577-8bd3-52859dd56a8f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:26.451702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311d48-1db0-4577-8bd3-52859dd56a8f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:26.453069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 738/1482] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:26.458583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf195d4-9fca-4677-be00-cd706d921879 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:26.459008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf195d4-9fca-4677-be00-cd706d921879 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:26.459156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf195d4-9fca-4677-be00-cd706d921879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:26.524319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fdf195d4-9fca-4677-be00-cd706d921879 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:26.525510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fdf195d4-9fca-4677-be00-cd706d921879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:26.572677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:26.623096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 745/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:26.907716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311d48-1db0-4577-8bd3-52859dd56a8f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:26.909311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c311d48-1db0-4577-8bd3-52859dd56a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:26.938915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:27.021867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311d48-1db0-4577-8bd3-52859dd56a8f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:27.094988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:27.095594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:27.095881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:27.096147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:27.097870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:27.173687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:27.207791 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:27.210099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278a0f6-e67c-470e-8a5f-c35ede473923 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:27.228896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 739/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:29.173832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9841-246b-4189-98b9-4da0e9307568 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:29.174383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9841-246b-4189-98b9-4da0e9307568 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:29.174383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9841-246b-4189-98b9-4da0e9307568 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:29.175654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 746/1485] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:29.180770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1943-97c1-4577-85b6-e51402e79a5a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:29.181165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1943-97c1-4577-85b6-e51402e79a5a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:29.181318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1943-97c1-4577-85b6-e51402e79a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:29.246898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-746a1943-97c1-4577-85b6-e51402e79a5a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:29.248285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-746a1943-97c1-4577-85b6-e51402e79a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:29.343368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 740/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:29.631959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9841-246b-4189-98b9-4da0e9307568 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:29.633873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2d9c9841-246b-4189-98b9-4da0e9307568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:29.740459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9841-246b-4189-98b9-4da0e9307568 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:29.815642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:29.817832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:29.818769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:29.819216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:29.819643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:29.821472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:29.940460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:29.941846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2068d7-67ac-4d03-b215-81683b53c654 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:29.960495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 747/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:31.997669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8795f-15d3-46c9-b179-7ad0ec985b72 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:31.998202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8795f-15d3-46c9-b179-7ad0ec985b72 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:31.998202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8795f-15d3-46c9-b179-7ad0ec985b72 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:32.000093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 741/1488] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:21:32.005461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a187fe-1034-4906-b571-fdf767144de1 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:32.005907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a187fe-1034-4906-b571-fdf767144de1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:32.006502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a187fe-1034-4906-b571-fdf767144de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:32.071755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-06a187fe-1034-4906-b571-fdf767144de1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:32.072988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-06a187fe-1034-4906-b571-fdf767144de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:32.124790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:32.168254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 748/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:32.463259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8795f-15d3-46c9-b179-7ad0ec985b72 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:32.464853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-08b8795f-15d3-46c9-b179-7ad0ec985b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:32.500442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:32.569187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8795f-15d3-46c9-b179-7ad0ec985b72 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:32.643899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:32.644543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:32.644823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:32.645092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:32.646686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:32.725745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:32.755593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:32.757225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5899a23-bf17-4dcd-be7b-956a17a269d1 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:32.777232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 742/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:34.867537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba1d2-9890-423d-8acd-d34a59e89a17 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:34.868127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba1d2-9890-423d-8acd-d34a59e89a17 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:34.868127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba1d2-9890-423d-8acd-d34a59e89a17 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:34.869449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 749/1491] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 17 19:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:34.875047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758bdde-2fda-4e06-a761-ebd74ff9b585 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:34.875446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758bdde-2fda-4e06-a761-ebd74ff9b585 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:34.875578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758bdde-2fda-4e06-a761-ebd74ff9b585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:34.939867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d758bdde-2fda-4e06-a761-ebd74ff9b585 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:34.941089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d758bdde-2fda-4e06-a761-ebd74ff9b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:35.037817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 743/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 17 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:35.353856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ba1d2-9890-423d-8acd-d34a59e89a17 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:35.355383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c74ba1d2-9890-423d-8acd-d34a59e89a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:35.463492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ba1d2-9890-423d-8acd-d34a59e89a17 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:35.535065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:35.535665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:35.535938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:35.536205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:35.537826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:35.547219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:35.645954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:35.647350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae432b-6e6e-4c60-9ebc-87c866381b2b service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:35.666806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 750/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:45.035854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=82 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:45.664472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=50 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:47.250397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:47.251004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:47.251004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:47.325286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:47.326484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:47.421234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 744/1494] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:47.429576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006bedb-6502-408c-a216-5836e8740767 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:47.430052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006bedb-6502-408c-a216-5836e8740767 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:47.430149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006bedb-6502-408c-a216-5836e8740767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:47.507340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9006bedb-6502-408c-a216-5836e8740767 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:47.508596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9006bedb-6502-408c-a216-5836e8740767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:47.606693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 751/1495] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:47.611281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:47.612531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:47.624732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c36d31-f311-4a57-a42b-65dc0099a2ec None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:47.685293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:47.719778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:47.720419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:47.720704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:47.720979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:47.721631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:22:47.721933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:47.722947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:47.722947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:22:47.722947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:22:47.723828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:47.734976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 745/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:22:47.743240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006bedb-6502-408c-a216-5836e8740767 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:47.753042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006bedb-6502-408c-a216-5836e8740767 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:47.815073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:47.848396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:47.849006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:47.849284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:47.849552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:47.850180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:47.851910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:47.851910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:22:47.851910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:22:47.853141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:47.908053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 752/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:22:47 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:22:47.912397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:47.914011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:47.948967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5a64-e8a2-4a29-8329-b09281d39b01 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:48.041830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:48.042429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.042703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.042966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.043572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:48.045108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:48.045108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:22:48.045108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:22:48.046308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:48.087073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 746/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:22:47 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:22:48.091467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:48.093062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:48.154908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6008548-6e08-4135-955e-49b928f68ed5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:48.235787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:48.248225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:48.248865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.249146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.249450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.250098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:48.251108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:48.251108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:22:48.251108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:22:48.252135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:48.264815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 753/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:22:48.268841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:48.270358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:48.282406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd80907-1660-44cb-b4eb-fdef8fbc13e0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:48.307332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:48.376544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:48.377134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.377405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.377669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.378298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:48.379289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:48.379289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:22:48.379289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:22:48.380164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc2d22-07b6-4c69-bb21-62e387208012 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:48.392103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 747/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:22:48.396269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:48.397810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:48.431253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6412424-63f1-4740-b1eb-93b60fbfcd73 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:48.524163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:48.524765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.525041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.525310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] PATH_INFO: `/v3/projects/a92068dee49a4073ba39624773fbc581/users/f5218259826e4ef19283ca9c787a9cb8/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.546771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92068dee49a4073ba39624773fbc581, user_id=f5218259826e4ef19283ca9c787a9cb8, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:48.547784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:48.547784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:22:48.547784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:22:48.549816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebacf3-ca6e-4521-b3a5-ed0a587427b7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:48.573850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 754/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:22:48 2022] PUT /identity/v3/projects/a92068dee49a4073ba39624773fbc581/users/f5218259826e4ef19283ca9c787a9cb8/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:22:48.586067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf4ba-f2fd-455e-848d-9125cebae05f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.586356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf4ba-f2fd-455e-848d-9125cebae05f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.586623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbf4ba-f2fd-455e-848d-9125cebae05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.641757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5adbf4ba-f2fd-455e-848d-9125cebae05f None None] MFA Rules not processed for user `f5218259826e4ef19283ca9c787a9cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:48.642957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5adbf4ba-f2fd-455e-848d-9125cebae05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:48.721108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 748/1502] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:48.734689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b62fc-2ee0-43dd-8f20-136ae98a447a None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.734974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b62fc-2ee0-43dd-8f20-136ae98a447a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.735247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b62fc-2ee0-43dd-8f20-136ae98a447a None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.736615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 755/1503] 10.222.0.62 () {54 vars in 964 bytes} [Wed Aug 17 19:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:22:48.741508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbde0c9-3473-4de7-8f60-b3e66505ba34 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:48.741809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbde0c9-3473-4de7-8f60-b3e66505ba34 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:48.742090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbde0c9-3473-4de7-8f60-b3e66505ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:48.774264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:48.823621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2bbde0c9-3473-4de7-8f60-b3e66505ba34 None None] MFA Rules not processed for user `f26c0d36d3054f098c05b3cdb93853b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:48.824857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2bbde0c9-3473-4de7-8f60-b3e66505ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:48.901164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 749/1504] 10.222.0.62 () {58 vars in 1061 bytes} [Wed Aug 17 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:48.910281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b62fc-2ee0-43dd-8f20-136ae98a447a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:48.911862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d88b62fc-2ee0-43dd-8f20-136ae98a447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:48.961955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:49.017344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b62fc-2ee0-43dd-8f20-136ae98a447a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:49.090313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:49.090961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:49.091408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:49.091685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:49.093299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:49.188528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:49.189949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:49.193414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:49.210556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 756/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:22:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:22:49.255719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bcce7-21b0-4f8c-a6b0-6c421d8b0091 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:49.256008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bcce7-21b0-4f8c-a6b0-6c421d8b0091 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:49.256323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bcce7-21b0-4f8c-a6b0-6c421d8b0091 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:49.257599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 750/1506] 10.222.0.62 () {52 vars in 830 bytes} [Wed Aug 17 19:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:22:49.261246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:49.263061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:49.361409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533962-2141-4cc0-a3a5-46428dfd2a73 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:49.453219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:49.453882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:49.454107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:49.454374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] PATH_INFO: `/v3/users/f5218259826e4ef19283ca9c787a9cb8` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:49.466859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5218259826e4ef19283ca9c787a9cb8)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:49.467876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:49.467876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:22:49.467876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:22:49.469104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:49.478825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:49.536095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5218259826e4ef19283ca9c787a9cb8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:49.558503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5218259826e4ef19283ca9c787a9cb8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:49.567727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5218259826e4ef19283ca9c787a9cb8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:49.568266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5218259826e4ef19283ca9c787a9cb8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:49.583176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5218259826e4ef19283ca9c787a9cb8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:49.588711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 757/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:22:49 2022] DELETE /identity/v3/users/f5218259826e4ef19283ca9c787a9cb8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:22:49.593323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:49.593781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:49.593909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:49.650242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:49.651439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:49.728088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:49.742868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 751/1508] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:49.752916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:49.754138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:49.855474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257ff55-3593-46e8-9548-25a0f0226f7c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:49.912773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:49.933086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:49.933698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:49.933978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:49.934800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:49.936713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:50.045430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:50.046865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924a92c-71f8-43df-aa9f-489d6237dd64 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:50.065491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 758/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:22:50.479835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:50.481189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:50.493515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312242-fb81-4ffc-ad9a-1dc1ee1a3adf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:50.592910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:50.593542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:50.594104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:50.594104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] PATH_INFO: `/v3/projects/a92068dee49a4073ba39624773fbc581` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:50.603730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92068dee49a4073ba39624773fbc581)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:50.604801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:22:50.604801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:22:50.604801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:22:50.605984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:50.662951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92068dee49a4073ba39624773fbc581', 'request_id': 'req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:50.676697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92068dee49a4073ba39624773fbc581', 'request_id': 'req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:50.682660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92068dee49a4073ba39624773fbc581', 'request_id': 'req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:50.708597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] The token cache is being invalidate because project a92068dee49a4073ba39624773fbc581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:22:50.708884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:50.709392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-43f8e6f0-f1c1-4fae-99c2-dfffed527da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:22:50.710690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 752/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:22:50 2022] DELETE /identity/v3/projects/a92068dee49a4073ba39624773fbc581 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:23:00.063258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=62 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:00.706214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:29.501549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5601-ff15-4023-b3c4-d45cf4aac6d8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:29.502175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5601-ff15-4023-b3c4-d45cf4aac6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:29.502175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5601-ff15-4023-b3c4-d45cf4aac6d8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:29.503429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:29.508164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311a2b-100c-4969-8204-8948cee77d57 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:29.508642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311a2b-100c-4969-8204-8948cee77d57 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:29.508755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311a2b-100c-4969-8204-8948cee77d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:29.592845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4f311a2b-100c-4969-8204-8948cee77d57 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:29.594061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4f311a2b-100c-4969-8204-8948cee77d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:29.699374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:29.859536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5601-ff15-4023-b3c4-d45cf4aac6d8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:29.861679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-966c5601-ff15-4023-b3c4-d45cf4aac6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:29.990059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5601-ff15-4023-b3c4-d45cf4aac6d8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:29.995546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b23ab-5e58-4f35-9004-2375a293b8f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:29.996155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b23ab-5e58-4f35-9004-2375a293b8f8 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:29.996481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b23ab-5e58-4f35-9004-2375a293b8f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:29.996757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b23ab-5e58-4f35-9004-2375a293b8f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:30.006083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b23ab-5e58-4f35-9004-2375a293b8f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:30.007378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b23ab-5e58-4f35-9004-2375a293b8f8 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:30.017872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 760/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:30.851033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e680-b42f-4ca7-b42d-48af853750ba None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:30.851621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e680-b42f-4ca7-b42d-48af853750ba None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:30.851621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e680-b42f-4ca7-b42d-48af853750ba None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:30.852987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:30.858386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91241164-af15-4833-ba10-6eea42f64700 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:30.858827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91241164-af15-4833-ba10-6eea42f64700 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:30.858938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91241164-af15-4833-ba10-6eea42f64700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:30.878393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-91241164-af15-4833-ba10-6eea42f64700 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:30.879588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-91241164-af15-4833-ba10-6eea42f64700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:30.887473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:31.038896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7e680-b42f-4ca7-b42d-48af853750ba None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:31.054213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7e680-b42f-4ca7-b42d-48af853750ba None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:31.060154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b2f8-805b-498e-9252-0c6c60e17c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:31.060784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b2f8-805b-498e-9252-0c6c60e17c04 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:31.061062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b2f8-805b-498e-9252-0c6c60e17c04 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:31.061330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b2f8-805b-498e-9252-0c6c60e17c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:31.070389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b2f8-805b-498e-9252-0c6c60e17c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:31.072003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b2f8-805b-498e-9252-0c6c60e17c04 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:31.081349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 755/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:31.121533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5e5f-3822-4302-b5ba-b4f55fd061cc None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:31.121818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5e5f-3822-4302-b5ba-b4f55fd061cc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:31.122100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5e5f-3822-4302-b5ba-b4f55fd061cc None None] PATH_INFO: `/v3` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:31.123426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 762/1517] 10.222.0.39 () {54 vars in 925 bytes} [Wed Aug 17 19:24:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:24:31.130069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1990-29bd-4712-bf7c-66361f43825c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:31.130356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1990-29bd-4712-bf7c-66361f43825c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:31.130632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1990-29bd-4712-bf7c-66361f43825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:31.195176 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-855d1990-29bd-4712-bf7c-66361f43825c None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:31.196417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-855d1990-29bd-4712-bf7c-66361f43825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:31.217157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:31.271756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 756/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 17 19:24:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:40.226457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1f0d1-d436-4d01-a927-f82b50ac1cda None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:40.226919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1f0d1-d436-4d01-a927-f82b50ac1cda None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:40.226919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1f0d1-d436-4d01-a927-f82b50ac1cda None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:40.228262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 763/1519] 10.222.0.62 () {54 vars in 961 bytes} [Wed Aug 17 19:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:40.234480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f6f84-5bff-4c6b-be7b-fd5eec806b95 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:40.234908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f6f84-5bff-4c6b-be7b-fd5eec806b95 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:40.235184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f6f84-5bff-4c6b-be7b-fd5eec806b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:40.255336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-602f6f84-5bff-4c6b-be7b-fd5eec806b95 None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:40.256838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-602f6f84-5bff-4c6b-be7b-fd5eec806b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:40.265625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 757/1520] 10.222.0.62 () {58 vars in 1058 bytes} [Wed Aug 17 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:40.273221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1f0d1-d436-4d01-a927-f82b50ac1cda None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:40.287004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1f0d1-d436-4d01-a927-f82b50ac1cda None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:40.293016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c2c77-dd13-4d94-8e5e-656304e89386 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:40.293616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2c77-dd13-4d94-8e5e-656304e89386 service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:40.293906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2c77-dd13-4d94-8e5e-656304e89386 service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:40.294178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c2c77-dd13-4d94-8e5e-656304e89386 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:40.311599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c2c77-dd13-4d94-8e5e-656304e89386 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:40.317644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c2c77-dd13-4d94-8e5e-656304e89386 service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:40.336473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 764/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:42.301596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502e0ae-eee8-4521-a203-ca49e2d5bb72 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:42.302120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502e0ae-eee8-4521-a203-ca49e2d5bb72 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:42.302120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502e0ae-eee8-4521-a203-ca49e2d5bb72 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:42.303524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:42.308893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d29f9-55b2-45df-8a3e-5c8ec88df9ee None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:42.309274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d29f9-55b2-45df-8a3e-5c8ec88df9ee None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:42.309439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d29f9-55b2-45df-8a3e-5c8ec88df9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:42.329131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7f0d29f9-55b2-45df-8a3e-5c8ec88df9ee None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:42.330330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7f0d29f9-55b2-45df-8a3e-5c8ec88df9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:42.338253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:42.490977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502e0ae-eee8-4521-a203-ca49e2d5bb72 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:42.505737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502e0ae-eee8-4521-a203-ca49e2d5bb72 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:42.511194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81e219-38c2-49b6-b863-6b89ba359e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:42.511781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81e219-38c2-49b6-b863-6b89ba359e3e service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:42.512057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81e219-38c2-49b6-b863-6b89ba359e3e service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:42.512356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81e219-38c2-49b6-b863-6b89ba359e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:42.520177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81e219-38c2-49b6-b863-6b89ba359e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:42.521768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81e219-38c2-49b6-b863-6b89ba359e3e service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:42.531051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 759/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:43.349777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39cf43-e5f5-4ec4-a5cf-fdd644b1e436 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:43.350309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39cf43-e5f5-4ec4-a5cf-fdd644b1e436 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:43.350427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39cf43-e5f5-4ec4-a5cf-fdd644b1e436 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:43.351725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:43.356626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ffcd-8bab-4f16-997a-65e206cb4a33 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:43.357072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ffcd-8bab-4f16-997a-65e206cb4a33 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:43.357180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ffcd-8bab-4f16-997a-65e206cb4a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:43.375993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5822ffcd-8bab-4f16-997a-65e206cb4a33 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:43.377215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5822ffcd-8bab-4f16-997a-65e206cb4a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:43.384939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:43.550519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39cf43-e5f5-4ec4-a5cf-fdd644b1e436 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:43.565510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39cf43-e5f5-4ec4-a5cf-fdd644b1e436 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:43.570899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0a15b-31f1-4232-8f0f-dc6e84874a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:43.571488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a15b-31f1-4232-8f0f-dc6e84874a09 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:43.571771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a15b-31f1-4232-8f0f-dc6e84874a09 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:43.572045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a15b-31f1-4232-8f0f-dc6e84874a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:43.580528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0a15b-31f1-4232-8f0f-dc6e84874a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:43.582118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0a15b-31f1-4232-8f0f-dc6e84874a09 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:43.593507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 767/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:47.642186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b2eb7-a255-45d9-9c2e-265b51e3434e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:47.642762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b2eb7-a255-45d9-9c2e-265b51e3434e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:47.642869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b2eb7-a255-45d9-9c2e-265b51e3434e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:47.644258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:47.649311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d10313-49f7-4f2d-9605-58aad4ce95f0 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:47.649692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d10313-49f7-4f2d-9605-58aad4ce95f0 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:47.649859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d10313-49f7-4f2d-9605-58aad4ce95f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:47.669205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d1d10313-49f7-4f2d-9605-58aad4ce95f0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:47.670452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d1d10313-49f7-4f2d-9605-58aad4ce95f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:47.678508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:47.964315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b2eb7-a255-45d9-9c2e-265b51e3434e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:47.966036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-439b2eb7-a255-45d9-9c2e-265b51e3434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:48.042981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b2eb7-a255-45d9-9c2e-265b51e3434e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:48.046493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b5a62-77e3-40aa-ad6c-79e47b83ed5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:48.047089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b5a62-77e3-40aa-ad6c-79e47b83ed5f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:48.047366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b5a62-77e3-40aa-ad6c-79e47b83ed5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:48.047637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b5a62-77e3-40aa-ad6c-79e47b83ed5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:48.056378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b5a62-77e3-40aa-ad6c-79e47b83ed5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:48.057962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b5a62-77e3-40aa-ad6c-79e47b83ed5f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:48.067089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 762/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:49.971157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df056-43af-4b77-a2b8-7e11b82ba386 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:49.971754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df056-43af-4b77-a2b8-7e11b82ba386 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:49.971754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df056-43af-4b77-a2b8-7e11b82ba386 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:49.973073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:49.978079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d22b3-7719-4713-ad4a-4fdc4beeabd0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:49.978477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d22b3-7719-4713-ad4a-4fdc4beeabd0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:49.978665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d22b3-7719-4713-ad4a-4fdc4beeabd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:50.000142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-be1d22b3-7719-4713-ad4a-4fdc4beeabd0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:50.001372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-be1d22b3-7719-4713-ad4a-4fdc4beeabd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:50.009101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:50.294652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df056-43af-4b77-a2b8-7e11b82ba386 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:50.300802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=75 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:50.308295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df056-43af-4b77-a2b8-7e11b82ba386 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:50.311824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e75e7d-282b-45b3-826b-5ef13e3043a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:50.312456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75e7d-282b-45b3-826b-5ef13e3043a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:50.312735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75e7d-282b-45b3-826b-5ef13e3043a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:50.313002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75e7d-282b-45b3-826b-5ef13e3043a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:50.321721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75e7d-282b-45b3-826b-5ef13e3043a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:50.323328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e75e7d-282b-45b3-826b-5ef13e3043a4 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:50.332808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 770/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:24:53.637402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782e38-fef4-4c46-a0a1-26b147948866 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:53.637949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782e38-fef4-4c46-a0a1-26b147948866 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:53.637949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782e38-fef4-4c46-a0a1-26b147948866 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:53.639252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:24:53.644290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f2a5-24e2-4aaa-a519-969ef5a9647f None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:53.644675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f2a5-24e2-4aaa-a519-969ef5a9647f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:53.644836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f2a5-24e2-4aaa-a519-969ef5a9647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:53.663939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d106f2a5-24e2-4aaa-a519-969ef5a9647f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:53.665169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d106f2a5-24e2-4aaa-a519-969ef5a9647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:53.673666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:54.217329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782e38-fef4-4c46-a0a1-26b147948866 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:54.218997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-05782e38-fef4-4c46-a0a1-26b147948866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:54.283793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:54.298032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782e38-fef4-4c46-a0a1-26b147948866 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:54.301748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90da3c-5121-408c-85de-b2fd2a858d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:54.302346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90da3c-5121-408c-85de-b2fd2a858d02 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:54.302623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90da3c-5121-408c-85de-b2fd2a858d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:54.302899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90da3c-5121-408c-85de-b2fd2a858d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:54.311833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90da3c-5121-408c-85de-b2fd2a858d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:54.313285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90da3c-5121-408c-85de-b2fd2a858d02 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:54.322464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 765/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:56.261759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c569b7-6128-4849-8a48-c34b864104ba None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:56.262321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c569b7-6128-4849-8a48-c34b864104ba None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:56.262321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c569b7-6128-4849-8a48-c34b864104ba None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:56.263554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:56.268811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72d598-bf92-46d2-aa65-03344e4bbf2b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:56.269216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72d598-bf92-46d2-aa65-03344e4bbf2b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:56.269372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72d598-bf92-46d2-aa65-03344e4bbf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:56.288552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9b72d598-bf92-46d2-aa65-03344e4bbf2b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:56.289808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9b72d598-bf92-46d2-aa65-03344e4bbf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:56.298468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:56.847738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c569b7-6128-4849-8a48-c34b864104ba None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:56.849471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-52c569b7-6128-4849-8a48-c34b864104ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:56.862878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c569b7-6128-4849-8a48-c34b864104ba None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:56.866344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95412f0e-072c-4e6b-ac8e-59d9dd46f6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:56.866935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95412f0e-072c-4e6b-ac8e-59d9dd46f6cb service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:56.867214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95412f0e-072c-4e6b-ac8e-59d9dd46f6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:56.867492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95412f0e-072c-4e6b-ac8e-59d9dd46f6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:56.876859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95412f0e-072c-4e6b-ac8e-59d9dd46f6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:56.878271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95412f0e-072c-4e6b-ac8e-59d9dd46f6cb service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:56.887449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 773/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:25:06.283705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=11 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:25:06.883427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=14 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:28.858882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:28.859967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:28.859967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:28.893779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:28.895047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:28.904173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 767/1540] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:28.914238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:28.914862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:28.914862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:28.947695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:28.948940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:28.970274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 774/1541] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:28.975679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:28.995280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747e43-ae62-426b-9173-80f70e6bbf56 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.008980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.009613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.009889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.010160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.010822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.011125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.013416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaf841-9a8d-4a2e-919e-430e94fb4c84 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.031271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 768/1542] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.040190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.044994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd0a1-30b7-46e1-8124-bd5157cc10b1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.045312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd0a1-30b7-46e1-8124-bd5157cc10b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.045559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dd0a1-30b7-46e1-8124-bd5157cc10b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.060640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a3b3e-9232-4d29-be62-ab528d8aaf61 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.072798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ece06-8c77-43c0-85a6-724ec33830a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.073501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ece06-8c77-43c0-85a6-724ec33830a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.073787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ece06-8c77-43c0-85a6-724ec33830a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.074195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ece06-8c77-43c0-85a6-724ec33830a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.075186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ece06-8c77-43c0-85a6-724ec33830a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.078816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ece06-8c77-43c0-85a6-724ec33830a7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.086439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dd7dd0a1-30b7-46e1-8124-bd5157cc10b1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.088036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dd7dd0a1-30b7-46e1-8124-bd5157cc10b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.099751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 769/1543] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:26:29.101125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487f16-82ef-4312-aafb-fe54418871aa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.101977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487f16-82ef-4312-aafb-fe54418871aa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.102264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487f16-82ef-4312-aafb-fe54418871aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.143165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-33487f16-82ef-4312-aafb-fe54418871aa None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.144422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-33487f16-82ef-4312-aafb-fe54418871aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.159034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 770/1544] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.162431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 775/1545] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.162783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.163094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.163457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.164125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b0d4-22de-4015-a5e2-9462cf568d7c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.164440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b0d4-22de-4015-a5e2-9462cf568d7c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.164827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b0d4-22de-4015-a5e2-9462cf568d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.197320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ebb9b0d4-22de-4015-a5e2-9462cf568d7c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.199042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ebb9b0d4-22de-4015-a5e2-9462cf568d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.207695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.209187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.277960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 771/1546] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.278580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.287217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 776/1547] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.287217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72859c4-8f02-4098-a7ad-fac08b9e4381 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.287217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72859c4-8f02-4098-a7ad-fac08b9e4381 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.287217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72859c4-8f02-4098-a7ad-fac08b9e4381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.288085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d204454-2be0-400c-8141-0b583c30d709 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.295155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bcbb7-1f8b-4d81-b84e-6bcff55668c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.298694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcbb7-1f8b-4d81-b84e-6bcff55668c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.298694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcbb7-1f8b-4d81-b84e-6bcff55668c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.298694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcbb7-1f8b-4d81-b84e-6bcff55668c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.298694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bcbb7-1f8b-4d81-b84e-6bcff55668c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.300130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bcbb7-1f8b-4d81-b84e-6bcff55668c4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.308898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c72859c4-8f02-4098-a7ad-fac08b9e4381 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.310133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c72859c4-8f02-4098-a7ad-fac08b9e4381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.318541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 777/1548] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.319792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41f2fe-f5e8-4634-a4c0-be377ff791a8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.320105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41f2fe-f5e8-4634-a4c0-be377ff791a8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.320552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41f2fe-f5e8-4634-a4c0-be377ff791a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.325606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 772/1549] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.328604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.328604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.328604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.341055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4e41f2fe-f5e8-4634-a4c0-be377ff791a8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.342613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4e41f2fe-f5e8-4634-a4c0-be377ff791a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.346913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.348085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.350502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 778/1550] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.352434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c068-8500-47d7-954a-4796c3efe078 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.352742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c068-8500-47d7-954a-4796c3efe078 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.353004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c068-8500-47d7-954a-4796c3efe078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.364751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 773/1551] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.364751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.369418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273455f-2ae8-46f2-8746-ffaaab74f566 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.376656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.377354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.377638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.377638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.377638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.377638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.377638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd27b-7f24-4866-9205-6ccc6341ea23 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.382692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-bf20c068-8500-47d7-954a-4796c3efe078 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.382884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bf20c068-8500-47d7-954a-4796c3efe078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.394927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 779/1552] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.394927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.394927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.395262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.398363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 774/1553] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.400785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.401378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.401664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.416959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.418157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.427366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 780/1554] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.428086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.428221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.429941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.439158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b9bb-7463-4b20-bf02-7cb809e4b98f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.441272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 775/1555] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.442144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.447627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.448371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.448650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.448928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.449876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.450179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.451253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:26:29.451253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:26:29.451253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:26:29.452136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878494a-060e-4508-8594-c83c7ef1fb4b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.454253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f30d-8382-4061-addd-662cf424c5fa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.459141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b4d3-2032-4bd6-8752-16910725220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.459752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b4d3-2032-4bd6-8752-16910725220f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.460034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b4d3-2032-4bd6-8752-16910725220f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.460929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b4d3-2032-4bd6-8752-16910725220f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.461681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b4d3-2032-4bd6-8752-16910725220f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.463510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b4d3-2032-4bd6-8752-16910725220f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.465773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 781/1556] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.466749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251be9-2233-4bf5-b747-fd05083e3071 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.467031 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251be9-2233-4bf5-b747-fd05083e3071 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.467302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251be9-2233-4bf5-b747-fd05083e3071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.479317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 776/1557] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:29.480970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.481262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.481535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.487427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a5251be9-2233-4bf5-b747-fd05083e3071 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.488651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a5251be9-2233-4bf5-b747-fd05083e3071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.496642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 782/1558] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.497807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.498084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.498357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.501454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.503228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.511877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 777/1559] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.512687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.518434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.519672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.522020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0e35e-f864-481a-a5cb-10888a04c3cb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.527388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.528022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.528144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 783/1560] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.528363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.528670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.528892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.529344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.530440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:26:29.530440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:26:29.530440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:26:29.531853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb221f5-a84d-4502-a103-3159fc92dbae admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.538212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0211e8-c897-43f7-9a93-50a39ad2506b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.542744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.543329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.543662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.543935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.544602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.544900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.546521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.571522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 778/1561] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.571752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 784/1562] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.571752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.571937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.571937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.571937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.572133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef46b-3ace-4457-a75e-071ef0f62364 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.584845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:29.586162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:29.624368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:29.627430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:29.632875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.633612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.633804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.634078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.634744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.636687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.649075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 779/1563] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:29.649851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.660599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc3c0a-3c5a-47c7-8d56-41946d959b97 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.665224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 785/1564] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.666313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.667247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.667924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.668424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.668815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.670193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.671404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.684355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 780/1565] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:29.688288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.697886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9f7f-47e2-4348-b0e5-8a87c9b6da09 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.734693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051ad41-b7a6-427f-8673-f937a3ac9272 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.739644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.740458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.740734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.741005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.742253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.742552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.744354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.756704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 786/1566] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.759410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.760026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.760351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.760625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.761272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.761581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.763181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.764901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.775926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf1fb8-2a36-48d7-a559-7fad1078df7d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.776968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 781/1567] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.777771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.787436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2bd4-febe-49c3-97a7-3b49b37e51bd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.787628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.788904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.789188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.789462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.790110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.790438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.792113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.793015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.793772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.793903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.794174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.795012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.796771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.805521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 787/1568] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.806330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.817726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feecc2-410a-47d8-980d-a7d2ab3ac84e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.822854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.823455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.823740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.824013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.824668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.825680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:26:29.825680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:26:29.825680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:26:29.826416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 782/1569] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.826940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.827228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.850428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 788/1570] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.851239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.861622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e9563-2d47-4501-8398-fbdc11ccb4e5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.890836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65be68d-857b-4892-86ec-3d0dad10ecd3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.895558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.896162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.896469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.896742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.897380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:29.898217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.900066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.911953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 783/1571] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:29.912960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.921323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.921948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.922229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.922530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.923155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.925155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.928142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b896cab-2b6a-44c2-b25b-8eb56d6d71f2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.933369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.934313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.934721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.934987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] PATH_INFO: `/v3/projects/16693c7d794a4615bcd154dc76de893c/users/4bf81750d77c422f8d99a0b7cbeea87c/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.950817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 789/1572] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:29.950817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.952200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16693c7d794a4615bcd154dc76de893c, user_id=4bf81750d77c422f8d99a0b7cbeea87c, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.953704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:26:29.953704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:26:29.953704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:26:29.956516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.958446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b417c-c879-48c3-a16f-27ef0517a250 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:29.964640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:29.965276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:29.965581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:29.965958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:29.966669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:29.968684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:29.972111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 784/1573] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:29 2022] PUT /identity/v3/projects/16693c7d794a4615bcd154dc76de893c/users/4bf81750d77c422f8d99a0b7cbeea87c/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:29.973257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:29.991814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:29.999795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 790/1574] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.001169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.015058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:30.042591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03492-d080-47c2-85a0-54d3c817f463 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.065092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498392-a4b8-4405-8f03-aca35a18b8b0 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.070843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.071291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.071567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.071843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.072495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.074412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.101230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 791/1575] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.102035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.106185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.106824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.107097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.107488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.108135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.110117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.139063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 785/1576] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:29 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.139716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.169696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d91be-9f7f-4b32-b830-28403ba1fe57 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.201632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae81ec2-15a7-4a24-ba6a-2e6ee7dcd412 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.206450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.207090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.207370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.207644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.208594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.210438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.220490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 786/1577] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.221145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.231409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f9b1-e0f7-4d3a-a07b-134332b2c1c1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.232059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.232756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.233066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.233367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.234040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.235934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1c85-d25b-49f0-bd15-23a4d3f85712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.236076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.236546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1c85-d25b-49f0-bd15-23a4d3f85712 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.236859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1c85-d25b-49f0-bd15-23a4d3f85712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.237133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1c85-d25b-49f0-bd15-23a4d3f85712 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.237753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1c85-d25b-49f0-bd15-23a4d3f85712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.239614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1c85-d25b-49f0-bd15-23a4d3f85712 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.261416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 792/1578] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.265178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.268711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 787/1579] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.269934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.270222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.270498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.275826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c279b-9f3f-4bdf-bbe7-54f17039f36a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.290172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:30.291385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:30.309002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:30.310873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:30.337262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.337886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.338188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.338449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.339095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.340750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.350680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 793/1580] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.352075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.356239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 788/1581] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:30.357078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.364177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1432-5ed6-4804-9c31-c686dfef9ebf admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.366261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dcb04-e624-4eb4-95d5-57d566054f0c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.370059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.370746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.371030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.371302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.371928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.372263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.372938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.373284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.373624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.373884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.374387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.376410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.399643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 794/1582] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.399643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.399924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 789/1583] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.403087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.407846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07d8d-b739-481c-b3b4-8b3cd12ed8ee admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.412545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2d3ee-ab92-4879-af8f-f29fd6bc3311 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.412685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.413913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.414808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.415092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.415724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.417673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.418054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.418709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.419068 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.419444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.420211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.421830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.434925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 790/1584] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.435769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.439809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 795/1585] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.440644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.446514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a574-2887-4cd9-8f17-8255ca732a11 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.451143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.451739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.452023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.452334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.452534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c7ae1-bde5-429c-9b99-16fa2ef7b1ab admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.452971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.454547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.457379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.458037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.458646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.458988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.460235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.462279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.465839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 791/1586] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.466657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.478663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990323b8-ff98-4d14-979e-837406a23eb3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.483636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.484226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.484536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.484813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.485446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.489195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 796/1587] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:30.489195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.489420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.490511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:30.498451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 792/1588] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.499247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.509332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d72d4b-32f3-4ded-b3bd-9cfa53e7e273 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.513962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.514548 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.514826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.515097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.515722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.517319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.528420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 793/1589] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.529285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.539168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420031d-33b2-4ad0-9da8-6360649d4ef5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.543886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.544498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.544789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.545053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.545680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.547235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.553154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bbb8a-0922-4702-b13a-ca1eb97c01d5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.557601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.558204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.558314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 794/1590] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.558479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.558746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.558983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.567792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.568266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a11e-4b14-4d6e-b32a-668fce7ddc86 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.569247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.573256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.573893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.574175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.574455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] PATH_INFO: `/v3/projects/c12fe8b76c4342c59c9ed906f9dbed05/users/60612f26098a404f9d1323cc95ee6bd0/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.578753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 797/1591] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:30.579556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.589118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a607285-209c-40f7-bdcf-b2ae889050a5 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.590535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12fe8b76c4342c59c9ed906f9dbed05, user_id=60612f26098a404f9d1323cc95ee6bd0, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.593303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.593938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.594597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.594940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.595275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.595941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.597538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.615221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 798/1592] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.615221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.615619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 795/1593] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:30 2022] PUT /identity/v3/projects/c12fe8b76c4342c59c9ed906f9dbed05/users/60612f26098a404f9d1323cc95ee6bd0/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:30.615619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.625298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fface-da24-47b9-833a-1bc62deadabd admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.685559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d58e-561e-486c-908a-157070847192 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.690768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.691473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.691840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.692123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.692849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.693558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.694263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.694547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.694768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.695130 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.696046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.697874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.709551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 796/1594] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.709551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.710008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 799/1595] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.710008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.719677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f361015-1d2a-4f56-a777-698ad859a5d0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.721749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1623d-558a-4959-9478-8952d8bd25b8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.725229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.726033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.726571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.726923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] PATH_INFO: `/v3/projects/48a18f6661d64c7bb97a8a4215c7e0fd/users/f233f0296a5a4e16ba0a6d4a8698da65/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.727160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.727838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.728306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.728613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.729295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.731496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.732724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:30.746948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 800/1596] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.747870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a18f6661d64c7bb97a8a4215c7e0fd, user_id=f233f0296a5a4e16ba0a6d4a8698da65, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.748022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.750916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.759774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5b36-b0dd-492a-965e-9a53c52d8f31 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.761189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:30.770272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 797/1597] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:30 2022] PUT /identity/v3/projects/48a18f6661d64c7bb97a8a4215c7e0fd/users/f233f0296a5a4e16ba0a6d4a8698da65/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:30.773203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.827069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3499c-1e78-4c91-a0cb-19dff5bf37e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.827793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3499c-1e78-4c91-a0cb-19dff5bf37e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.828183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3499c-1e78-4c91-a0cb-19dff5bf37e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.828570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3499c-1e78-4c91-a0cb-19dff5bf37e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.829695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3499c-1e78-4c91-a0cb-19dff5bf37e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.831018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3499c-1e78-4c91-a0cb-19dff5bf37e3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.842631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 801/1598] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.843952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.844259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.844528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.855345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43d8b7-9dd3-4cac-8bba-bc3b48b5df58 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.861182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.861820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.862100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.862372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.863003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.863763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:30.864899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.865036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:30.873420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 802/1599] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:30.874025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.876136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 798/1600] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.877088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.886702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83622b3-3f2e-42ca-8deb-57583398a886 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.887461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c16a43-5ba6-4918-8b19-e4936214d08f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.892037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9222082-91dd-4868-89ec-ca69cfefa709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.892657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:30.892768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222082-91dd-4868-89ec-ca69cfefa709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.893000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222082-91dd-4868-89ec-ca69cfefa709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.893203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.893311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9222082-91dd-4868-89ec-ca69cfefa709 admin admin] PATH_INFO: `/v3/projects/27290999df9d40c9924e6a381e2159cf/users/ed3573fdb47f4fb6a280ef5d69674ce5/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.893675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.894038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.894783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.896740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.911918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 803/1601] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:30.912128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222082-91dd-4868-89ec-ca69cfefa709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27290999df9d40c9924e6a381e2159cf, user_id=ed3573fdb47f4fb6a280ef5d69674ce5, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:30.912221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:30.912385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9222082-91dd-4868-89ec-ca69cfefa709 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:30.922136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180e736-ac9d-43b9-acad-4099055ccba6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:30.928119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 799/1602] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:30 2022] PUT /identity/v3/projects/27290999df9d40c9924e6a381e2159cf/users/ed3573fdb47f4fb6a280ef5d69674ce5/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:30.933688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:30.934389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:30.935075 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:30.966047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:30.967623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:31.005227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.007222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.008042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.009108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] PATH_INFO: `/v3/projects/2e1ab3e8029e4d419796787c256ac59e/users/821a1c2492294cf8a8d4f9dcf20f8860/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.028809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1ab3e8029e4d419796787c256ac59e, user_id=821a1c2492294cf8a8d4f9dcf20f8860, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.033227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.041049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 800/1603] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:31.041950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.051435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 804/1604] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:30 2022] PUT /identity/v3/projects/2e1ab3e8029e4d419796787c256ac59e/users/821a1c2492294cf8a8d4f9dcf20f8860/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:31.052321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.062194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae336cf-cf2a-4b1e-8b85-62fd881ed390 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.120674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:31.124948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6a4d-409c-4f00-8392-8bfd04fd39df admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.131714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.132940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.133214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.133486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] PATH_INFO: `/v3/projects/186875e6bf1f4fbe83b8591b715da83f/users/9dec5ac08f6e42bd82d00baed6d585c8/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.134576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.135391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.135679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.135961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] PATH_INFO: `/v3/projects/dbcd4079068e43699502d80149889b5c/users/b6abbb7d1e594809876398462408bdfc/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.150818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186875e6bf1f4fbe83b8591b715da83f, user_id=9dec5ac08f6e42bd82d00baed6d585c8, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.151557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcd4079068e43699502d80149889b5c, user_id=b6abbb7d1e594809876398462408bdfc, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.153687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.154268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.156861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:31.170550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 801/1605] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:31 2022] PUT /identity/v3/projects/dbcd4079068e43699502d80149889b5c/users/b6abbb7d1e594809876398462408bdfc/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:31.171561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 805/1606] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:31 2022] PUT /identity/v3/projects/186875e6bf1f4fbe83b8591b715da83f/users/9dec5ac08f6e42bd82d00baed6d585c8/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:31.172366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.172564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.240972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efa943-0a51-4615-8c68-5dec3284a4ea admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.247930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7297280-7857-41d6-b308-355a5c99daf0 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.254897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8de53-1dd7-4984-ad7b-002919919476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.254897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8de53-1dd7-4984-ad7b-002919919476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.254897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8de53-1dd7-4984-ad7b-002919919476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.254897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8de53-1dd7-4984-ad7b-002919919476 admin admin] PATH_INFO: `/v3/projects/32025e1eac624a0680ea34eec85c8125/users/95df35149a7842c2b8908aeb56516d9e/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.270748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8de53-1dd7-4984-ad7b-002919919476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32025e1eac624a0680ea34eec85c8125, user_id=95df35149a7842c2b8908aeb56516d9e, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.273795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8de53-1dd7-4984-ad7b-002919919476 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.290789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 806/1607] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:31 2022] PUT /identity/v3/projects/32025e1eac624a0680ea34eec85c8125/users/95df35149a7842c2b8908aeb56516d9e/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:31.292483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b723f-2d1f-4e26-8b53-1a50368edac9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.292839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b723f-2d1f-4e26-8b53-1a50368edac9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.293180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b723f-2d1f-4e26-8b53-1a50368edac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.314619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.315782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.316092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.316509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.328969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.335777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9d2b723f-2d1f-4e26-8b53-1a50368edac9 None None] MFA Rules not processed for user `ed3573fdb47f4fb6a280ef5d69674ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:31.337149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9d2b723f-2d1f-4e26-8b53-1a50368edac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:31.345069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.361761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 802/1608] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:31.363015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.374197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e64db-5aaa-49a2-b20f-16be03c0e710 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.448944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38c7ea-4ba6-42ee-b63b-30e9f240925e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.449636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c7ea-4ba6-42ee-b63b-30e9f240925e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.450041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c7ea-4ba6-42ee-b63b-30e9f240925e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.450510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c7ea-4ba6-42ee-b63b-30e9f240925e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.506576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 807/1609] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:31.522553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983cdb5-c9c6-48fe-9038-712c5a780ab9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.523352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983cdb5-c9c6-48fe-9038-712c5a780ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.523648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983cdb5-c9c6-48fe-9038-712c5a780ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.542656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38c7ea-4ba6-42ee-b63b-30e9f240925e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.544874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38c7ea-4ba6-42ee-b63b-30e9f240925e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.572276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 803/1610] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:31.576184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3c85-c9b7-4fcd-9073-2a61757e69f3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.576662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3c85-c9b7-4fcd-9073-2a61757e69f3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.577528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3c85-c9b7-4fcd-9073-2a61757e69f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.595056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:31.600022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b983cdb5-c9c6-48fe-9038-712c5a780ab9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:31.602247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b983cdb5-c9c6-48fe-9038-712c5a780ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:31.627872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 808/1611] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:31.630523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e161c-d1df-4b12-b312-6dd1765a9592 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.633781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e161c-d1df-4b12-b312-6dd1765a9592 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.633781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e161c-d1df-4b12-b312-6dd1765a9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.649829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-60ea3c85-c9b7-4fcd-9073-2a61757e69f3 None None] MFA Rules not processed for user `b6abbb7d1e594809876398462408bdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:31.654228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-60ea3c85-c9b7-4fcd-9073-2a61757e69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:31.697226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-285e161c-d1df-4b12-b312-6dd1765a9592 None None] MFA Rules not processed for user `9dec5ac08f6e42bd82d00baed6d585c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:31.701217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-285e161c-d1df-4b12-b312-6dd1765a9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:31.791249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:31.818697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 804/1612] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:31.826604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.826895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.827175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.870302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 809/1613] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:31.870445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:31.871439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1746b6-9b03-4088-b684-1407fdec1eca None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.871674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:31.873842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1746b6-9b03-4088-b684-1407fdec1eca None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.874146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1746b6-9b03-4088-b684-1407fdec1eca None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.875698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 810/1614] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 17 19:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:31.883490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1746b6-9b03-4088-b684-1407fdec1eca None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.885658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 805/1615] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:31.886691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.899568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dabc0f-8fb9-4598-9ab7-7df56a0ad662 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.906022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.907171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.907584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.907988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.908776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.911113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.914957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1746b6-9b03-4088-b684-1407fdec1eca None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:31.922848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878c0ba-a4c5-4467-8f67-c41f2700b28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:31.923510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c0ba-a4c5-4467-8f67-c41f2700b28b service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.923794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c0ba-a4c5-4467-8f67-c41f2700b28b service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.924069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c0ba-a4c5-4467-8f67-c41f2700b28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:31.948160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878c0ba-a4c5-4467-8f67-c41f2700b28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:31.949085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 806/1616] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:31.951836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878c0ba-a4c5-4467-8f67-c41f2700b28b service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:31.954026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:31.976917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 811/1617] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:31.980904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:31.980904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:31.980904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.031708 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af00edb-b639-41e3-b102-1423a1c0f90f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.046535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.047433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.047799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.048305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.051151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.056973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.060269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:32.062220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:32.116703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 807/1618] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/projects => generated 405 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:32.119053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.234847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 812/1619] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 17 19:26:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:32.237456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.270583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:32.297259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd63bf1-6812-4b4f-9a09-d41e9cd44548 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.309007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.310259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.310551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.310824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.311460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.313443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.351719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd9cca-6c04-4e44-8ae2-126f16761c90 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.353884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 808/1620] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:32 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:32.355467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.373804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51ac2-6679-42c1-9fbe-2f3bc301a3b0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.379129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.380586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.381007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.381496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.382488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.384909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.432695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 809/1621] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:32 2022] POST /identity/v3/users => generated 309 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:32.436997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.448907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.449842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.451910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.452510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.575105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.575105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.575105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:32.575105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 813/1622] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:32.575105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.606726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046bde-a6e1-4ba0-ad7c-a5ee734bb2ab service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.620595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adefb20-c2de-43fe-940a-6f1769910ffc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.623485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.624120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.625215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.625505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.626166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.627793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.636690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.637877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.638370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.638844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.653571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 814/1623] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:32.653571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.666076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e912c-7af8-4c88-856e-826e913dcff4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.675742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.677427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.678378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.679383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.682986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.686580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.720372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 815/1624] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:32.722661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.739873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ce7ae-5218-4d00-94c9-86e955473db4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.751254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.751902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.752308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.752713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] PATH_INFO: `/v3/projects/2251275cc8714f13a31da10d72bd7ae2/users/7d0a1cba69da4495b270b4843f1476aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.774835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2251275cc8714f13a31da10d72bd7ae2, user_id=7d0a1cba69da4495b270b4843f1476aa, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.778884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.795056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.797188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.801764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 816/1625] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:32 2022] PUT /identity/v3/projects/2251275cc8714f13a31da10d72bd7ae2/users/7d0a1cba69da4495b270b4843f1476aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:32.806216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.809994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 810/1626] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:32.811101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.825246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb4b1-5b3c-47de-a02c-916ef764fc69 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.905528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:32.914454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.915680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.916341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.917002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.917864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.920317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:32.937474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 811/1627] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:32.941065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:32.942002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73d51-8783-4b47-8f94-4932b80dc46e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.954945 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ae88-b0d5-4db3-9a1c-58ac7a341def admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:32.957674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.960087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.960600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.962112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b2166-9c39-445e-ad0c-f9a980864813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:32.963173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2166-9c39-445e-ad0c-f9a980864813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:32.963444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] PATH_INFO: `/v3/projects/b9ba003633d64060b41dcfb8fc58bd37/users/2a7fe4f60a6640b19759b1cbdcf5a683/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.964050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2166-9c39-445e-ad0c-f9a980864813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:32.965074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b2166-9c39-445e-ad0c-f9a980864813 admin admin] PATH_INFO: `/v3/projects/2251275cc8714f13a31da10d72bd7ae2/users/7d0a1cba69da4495b270b4843f1476aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:32.968137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b2166-9c39-445e-ad0c-f9a980864813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2251275cc8714f13a31da10d72bd7ae2, user_id=7d0a1cba69da4495b270b4843f1476aa, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:32.972077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b2166-9c39-445e-ad0c-f9a980864813 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:33.000308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 812/1628] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:32 2022] PUT /identity/v3/projects/2251275cc8714f13a31da10d72bd7ae2/users/7d0a1cba69da4495b270b4843f1476aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:33.011327 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ba003633d64060b41dcfb8fc58bd37, user_id=2a7fe4f60a6640b19759b1cbdcf5a683, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:33.014161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:33.017950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.018361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.018713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.041512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 817/1629] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:32 2022] PUT /identity/v3/projects/b9ba003633d64060b41dcfb8fc58bd37/users/2a7fe4f60a6640b19759b1cbdcf5a683/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:33.049627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:33.090133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] MFA Rules not processed for user `7d0a1cba69da4495b270b4843f1476aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:33.091592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:33.221240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2279-db49-48e5-a30e-a6cccbcbff5c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:33.230088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 813/1630] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:33.231172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9a9b-b936-4529-bd35-2ff0e13c580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:33.231828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9a9b-b936-4529-bd35-2ff0e13c580a admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.232109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9a9b-b936-4529-bd35-2ff0e13c580a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.232416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9a9b-b936-4529-bd35-2ff0e13c580a admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.233102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9a9b-b936-4529-bd35-2ff0e13c580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:33.238087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9a9b-b936-4529-bd35-2ff0e13c580a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:33.248359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:33.261933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 818/1631] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:33.263261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1566-2d55-4b7b-a17a-bcb2067e560a None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.263575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1566-2d55-4b7b-a17a-bcb2067e560a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.263886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a1566-2d55-4b7b-a17a-bcb2067e560a None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.265469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 819/1632] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 17 19:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:33.266260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a1566-2d55-4b7b-a17a-bcb2067e560a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:33.280923 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a1566-2d55-4b7b-a17a-bcb2067e560a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:33.286197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057e24-7f82-4911-9f2c-33b592ee3aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:33.287053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057e24-7f82-4911-9f2c-33b592ee3aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.287532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057e24-7f82-4911-9f2c-33b592ee3aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.288682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057e24-7f82-4911-9f2c-33b592ee3aef admin admin] PATH_INFO: `/v3/projects/b9ba003633d64060b41dcfb8fc58bd37/users/2a7fe4f60a6640b19759b1cbdcf5a683/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.291303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057e24-7f82-4911-9f2c-33b592ee3aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ba003633d64060b41dcfb8fc58bd37, user_id=2a7fe4f60a6640b19759b1cbdcf5a683, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:33.295272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057e24-7f82-4911-9f2c-33b592ee3aef admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:33.312005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 820/1633] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:33 2022] PUT /identity/v3/projects/b9ba003633d64060b41dcfb8fc58bd37/users/2a7fe4f60a6640b19759b1cbdcf5a683/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:33.321730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24a4d3-1124-43e5-b08e-1cc1e4de9320 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.321730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24a4d3-1124-43e5-b08e-1cc1e4de9320 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.321730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24a4d3-1124-43e5-b08e-1cc1e4de9320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.348551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6530a0-a9a4-4349-9796-3a3bc25aa4cc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:33.349979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-bd24a4d3-1124-43e5-b08e-1cc1e4de9320 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:33.351908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bd24a4d3-1124-43e5-b08e-1cc1e4de9320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:33.371704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:33.470799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 821/1634] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:26:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:33.475942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.478563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.478860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.499404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0abf7-d491-4766-9bcb-336b8a843810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:33.500052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0abf7-d491-4766-9bcb-336b8a843810 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.500366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0abf7-d491-4766-9bcb-336b8a843810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.500701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0abf7-d491-4766-9bcb-336b8a843810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.545605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] MFA Rules not processed for user `2a7fe4f60a6640b19759b1cbdcf5a683`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:33.546966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:33.597946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:33.673917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0abf7-d491-4766-9bcb-336b8a843810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:33.676042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 822/1635] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:33.676369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0abf7-d491-4766-9bcb-336b8a843810 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:33.677470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:33.694139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ad155-1b9a-4fe7-8acf-e3f9e8d10db9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:33.695321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 814/1636] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:33.715765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:33.717759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.718048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.718337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.749458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:33.753007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:33.777534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 823/1637] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:33.821542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:33.821938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:33.822282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:33.891804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] MFA Rules not processed for user `f233f0296a5a4e16ba0a6d4a8698da65`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:33.897272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:34.063016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 815/1638] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:34.067799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:34.256192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb63d31-6c81-485a-ae9d-6ac3d7d71b7e service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:34.270205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:34.271259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:34.272854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:34.273308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:34.274835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:34.278816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:34.365600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 824/1639] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:34 2022] POST /identity/v3/projects => generated 403 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:34.365856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:34.386702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee1a5-5568-467d-8192-48dd13855ae0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:34.587996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:34.588819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:34.589194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:34.589562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:34.590301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:34.592348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:34.635352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 816/1640] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:34 2022] POST /identity/v3/users => generated 308 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:34.637592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:34.652541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1587c-6ac1-4946-b82a-83a85539b4de admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:34.667224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:34.668208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:34.668826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:34.669261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:34.670086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:34.671859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:34.680613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:34.701141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:34.702794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 825/1641] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:34.712059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0c5ea-fa56-48fc-a7f1-7b64ae46c984 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:34.727137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:34.727931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:34.730620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:34.731030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] PATH_INFO: `/v3/projects/f6e40886aaf44df69dcb2a266a5c2f9d/users/57cd70a321ad4e7e97e13cc390fa4e77/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:34.766274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e40886aaf44df69dcb2a266a5c2f9d, user_id=57cd70a321ad4e7e97e13cc390fa4e77, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:34.769084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:34.797331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 817/1642] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:34 2022] PUT /identity/v3/projects/f6e40886aaf44df69dcb2a266a5c2f9d/users/57cd70a321ad4e7e97e13cc390fa4e77/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:26:34.803390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:34.820803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc55ab2-e629-4a76-beff-04babaca3b25 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:34.958764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:34.959447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:34.959727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:34.959995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:34.960756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:34.962425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:34.999242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:35.007708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 826/1643] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:35.011099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:35.051087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4c6b2-cd92-434a-bb98-046956ff4236 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:35.067814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dac9b-89d0-4411-a198-d1f5d5d3eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:35.075657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dac9b-89d0-4411-a198-d1f5d5d3eca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:35.075981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dac9b-89d0-4411-a198-d1f5d5d3eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:35.076280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dac9b-89d0-4411-a198-d1f5d5d3eca9 admin admin] PATH_INFO: `/v3/projects/f6e40886aaf44df69dcb2a266a5c2f9d/users/57cd70a321ad4e7e97e13cc390fa4e77/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:35.081519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dac9b-89d0-4411-a198-d1f5d5d3eca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e40886aaf44df69dcb2a266a5c2f9d, user_id=57cd70a321ad4e7e97e13cc390fa4e77, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:35.092516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dac9b-89d0-4411-a198-d1f5d5d3eca9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:35.121238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:35.131227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 827/1644] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:35 2022] PUT /identity/v3/projects/f6e40886aaf44df69dcb2a266a5c2f9d/users/57cd70a321ad4e7e97e13cc390fa4e77/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:35.220904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798db85-8e08-45c4-b01c-69adf3ffb95d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:35.331999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183ee9-fcdc-47e8-9ea9-995b6ca867f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:35.332668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183ee9-fcdc-47e8-9ea9-995b6ca867f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:35.332949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183ee9-fcdc-47e8-9ea9-995b6ca867f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:35.333476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183ee9-fcdc-47e8-9ea9-995b6ca867f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:35.470302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66183ee9-fcdc-47e8-9ea9-995b6ca867f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:35.472328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66183ee9-fcdc-47e8-9ea9-995b6ca867f5 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:35.499808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 818/1645] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:35.775608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fccac-108a-4649-b2bf-d1e6846e0daa None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:35.775910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fccac-108a-4649-b2bf-d1e6846e0daa None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:35.776169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fccac-108a-4649-b2bf-d1e6846e0daa None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:35.777643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 828/1646] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 17 19:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:35.797222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78a3c-7b37-4232-943e-5278714bd56c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:35.797510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78a3c-7b37-4232-943e-5278714bd56c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:35.797787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78a3c-7b37-4232-943e-5278714bd56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:35.855399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c1c78a3c-7b37-4232-943e-5278714bd56c None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:35.857768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c1c78a3c-7b37-4232-943e-5278714bd56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:35.972111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fccac-108a-4649-b2bf-d1e6846e0daa None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:36.036957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 819/1647] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 17 19:26:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:36.041241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444007-ae2c-4c18-b865-34458783cc89 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:36.041525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444007-ae2c-4c18-b865-34458783cc89 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:36.047376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444007-ae2c-4c18-b865-34458783cc89 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:36.061506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 820/1648] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 17 19:26:36 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:36.064927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:36.065318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:36.065597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:36.110439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:36.115455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:36.147035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 821/1649] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:26:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:36.165030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:36.165849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fccac-108a-4649-b2bf-d1e6846e0daa None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:36.174114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:36.175271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:36.175271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:36.175774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] PATH_INFO: `/v3/users/9dec5ac08f6e42bd82d00baed6d585c8` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:36.177694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dec5ac08f6e42bd82d00baed6d585c8)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:36.179955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:36.185812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814362f9-56ed-4b14-9ee0-eed23510006c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:36.197818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a528cab-5d13-462f-983b-850663990a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:36.198462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528cab-5d13-462f-983b-850663990a20 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:36.198743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528cab-5d13-462f-983b-850663990a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:36.200515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a528cab-5d13-462f-983b-850663990a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:36.242419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528cab-5d13-462f-983b-850663990a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:36.244010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a528cab-5d13-462f-983b-850663990a20 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:36.266982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 822/1650] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:26:36.305535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dec5ac08f6e42bd82d00baed6d585c8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:36.319069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dec5ac08f6e42bd82d00baed6d585c8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:36.330846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dec5ac08f6e42bd82d00baed6d585c8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:36.332021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dec5ac08f6e42bd82d00baed6d585c8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:36.344092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dec5ac08f6e42bd82d00baed6d585c8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:36.347337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:36.353442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 829/1651] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:35 2022] DELETE /identity/v3/users/9dec5ac08f6e42bd82d00baed6d585c8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:36.357969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:36.358442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:36.358823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:36.384328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:36.385876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:36.393847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:36.489224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 823/1652] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:36.499565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:36.503149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:36.649622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e77b3c-8046-46f9-88ea-769a1ef6fc0c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:36.657026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:36.657977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:36.658744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:36.659241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:36.676219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:36.679101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:36.693376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 830/1653] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:26:38.111036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:38.112484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:38.145738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200962b3-56da-4f30-9dc9-24ac702002de None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:38.169138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:38.170841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:38.171524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:38.172508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] PATH_INFO: `/v3/projects/186875e6bf1f4fbe83b8591b715da83f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:38.175850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186875e6bf1f4fbe83b8591b715da83f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:38.179461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:38.308264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186875e6bf1f4fbe83b8591b715da83f', 'request_id': 'req-4f102002-3737-4f45-8a80-2a9352de84c0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.324550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186875e6bf1f4fbe83b8591b715da83f', 'request_id': 'req-4f102002-3737-4f45-8a80-2a9352de84c0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.338751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186875e6bf1f4fbe83b8591b715da83f', 'request_id': 'req-4f102002-3737-4f45-8a80-2a9352de84c0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.376040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] The token cache is being invalidate because project 186875e6bf1f4fbe83b8591b715da83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:26:38.376040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.377074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4f102002-3737-4f45-8a80-2a9352de84c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.385377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 824/1654] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:26:38 2022] DELETE /identity/v3/projects/186875e6bf1f4fbe83b8591b715da83f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:38.389512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:38.428955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e544a51-758c-431c-939d-822a35a9cefc service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:38.603537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:38.604190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:38.604493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:38.604763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] PATH_INFO: `/v3/users/2a7fe4f60a6640b19759b1cbdcf5a683` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:38.606695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7fe4f60a6640b19759b1cbdcf5a683)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:38.609061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:38.733914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7fe4f60a6640b19759b1cbdcf5a683'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.751700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7fe4f60a6640b19759b1cbdcf5a683'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.761711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7fe4f60a6640b19759b1cbdcf5a683'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.762633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7fe4f60a6640b19759b1cbdcf5a683'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.782383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7fe4f60a6640b19759b1cbdcf5a683'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:38.791037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 831/1655] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:38 2022] DELETE /identity/v3/users/2a7fe4f60a6640b19759b1cbdcf5a683 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:38.902288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:38.902637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:38.902919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:38.930905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:38.934722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:38.962798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] MFA Rules not processed for user `57cd70a321ad4e7e97e13cc390fa4e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:38.964094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:39.045346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:39.091794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7582264-e3b7-46e2-8aa3-7adfb6a6b7c3 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:39.099399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:39.100378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:39.102260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:39.102799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:39.105720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:39.191242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 825/1656] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:39.201164 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:39.202863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6e23c-6f11-4336-b4c3-6ff2e3945fad service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:39.238272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 832/1657] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:26:40.554633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:40.565051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:40.627939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:40.750371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c2bf-7d37-4586-a38a-cb17da4dda32 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:40.761837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:40.763190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:40.764645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:40.765058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] PATH_INFO: `/v3/projects/b9ba003633d64060b41dcfb8fc58bd37` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:40.768938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ba003633d64060b41dcfb8fc58bd37)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:40.770936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:40.890575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ba003633d64060b41dcfb8fc58bd37', 'request_id': 'req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:40.900550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ba003633d64060b41dcfb8fc58bd37', 'request_id': 'req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:40.932519 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ba003633d64060b41dcfb8fc58bd37', 'request_id': 'req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:40.968541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] The token cache is being invalidate because project b9ba003633d64060b41dcfb8fc58bd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:26:40.968842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:40.970192 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1f480d5c-5aba-4c4f-ae13-ebf29ecc8afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:40.979082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:40.979552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 826/1658] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:26:40 2022] DELETE /identity/v3/projects/b9ba003633d64060b41dcfb8fc58bd37 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:40.979632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:40.979632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:41.039063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:41.040527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:41.217686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f306-26b4-4c9c-a965-ec9ed410615f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:41.218251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f306-26b4-4c9c-a965-ec9ed410615f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:41.218722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f306-26b4-4c9c-a965-ec9ed410615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:41.221375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 833/1659] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:41.277254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1189f306-26b4-4c9c-a965-ec9ed410615f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:41.282105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1189f306-26b4-4c9c-a965-ec9ed410615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:41.315576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 827/1660] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:41.318168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:41.341789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73233-1c47-4db2-8733-06d3293961ee None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:41.378355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:41.379589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:41.382062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:41.383026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:41.384016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:41.387786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:41.391462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:41.415923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:41.416210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:41.416525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:41.462342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 834/1661] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:41.463877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:41.498915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a764-2096-4ffc-9e99-51ad2a96a013 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:41.503280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] MFA Rules not processed for user `4bf81750d77c422f8d99a0b7cbeea87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:41.504605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:41.513927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:41.514709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:41.514964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:41.515206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:41.515927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:41.518095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:41.644728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 835/1662] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:41 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:41.646213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:41.784719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 828/1663] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:41.802475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:41.804992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:41.828511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:41.867609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:41.903367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a3ad-e573-48bb-8907-38ccb481f7e8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:41.917596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:41.920818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:41.921158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:41.921478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:41.922171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:41.936294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:41.986863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 836/1664] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:41 2022] POST /identity/v3/users => generated 286 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:41.998366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:42.018108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec62cd-53a2-4362-9ee1-a4588779515e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:42.031393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cec0d-9ef6-4916-909c-defc3c9a3d07 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:42.047303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:42.049955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.050819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.051761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:42.054801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:42.060789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:42.091089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 837/1665] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:42.094401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:42.123975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf076f6-d691-40f3-8b4a-7c17f972fb37 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:42.136870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:42.139594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.140085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.140982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:42.142381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:42.147124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:42.183556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 838/1666] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:42.186683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:42.215229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3b67-78f5-48cc-b1d1-07dc228d928f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:42.228843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2872147-2c85-4470-8f70-9de1ee35c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:42.231856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2872147-2c85-4470-8f70-9de1ee35c43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.231856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2872147-2c85-4470-8f70-9de1ee35c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.231856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2872147-2c85-4470-8f70-9de1ee35c43e admin admin] PATH_INFO: `/v3/projects/872e510078aa4c53a5b2c706ee81eea2/users/8620a60cc24a49a392166940e2ba7ee8/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:42.281407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2872147-2c85-4470-8f70-9de1ee35c43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=872e510078aa4c53a5b2c706ee81eea2, user_id=8620a60cc24a49a392166940e2ba7ee8, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:42.288788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2872147-2c85-4470-8f70-9de1ee35c43e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:42.326423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 839/1667] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:42 2022] PUT /identity/v3/projects/872e510078aa4c53a5b2c706ee81eea2/users/8620a60cc24a49a392166940e2ba7ee8/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:26:42.338958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.339107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:42.339241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.339518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:42.339881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.355635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.356093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:42.454228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] MFA Rules not processed for user `8620a60cc24a49a392166940e2ba7ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:42.455605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:42.645717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:42.647940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:42.682695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 829/1668] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:42.683672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:42.692821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:42.720974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 840/1669] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:26:42.725095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:42.727278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c5248-2077-4ea2-93c8-d5c7027b8c04 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:42.812792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:42.815010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.815551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.815981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] PATH_INFO: `/v3/users/ed3573fdb47f4fb6a280ef5d69674ce5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:42.817556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3573fdb47f4fb6a280ef5d69674ce5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:42.818922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:26:42.818922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: warnings.warn(msg) Aug 17 19:26:42.818922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: Aug 17 19:26:42.821343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:42.829342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:42.919467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3573fdb47f4fb6a280ef5d69674ce5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:42.930746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3573fdb47f4fb6a280ef5d69674ce5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:42.931787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3573fdb47f4fb6a280ef5d69674ce5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:42.932549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3573fdb47f4fb6a280ef5d69674ce5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:42.950498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9c75c0e4-58ea-40a8-8881-60ef4adbd2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3573fdb47f4fb6a280ef5d69674ce5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:42.988799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315882da-5b5c-4290-a685-1bdb541d7a27 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:42.990552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 830/1670] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:42 2022] DELETE /identity/v3/users/ed3573fdb47f4fb6a280ef5d69674ce5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:42.996552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:42.996726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:42.996959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.026128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:43.041651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:43.043296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:43.124887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.125902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.126577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.126999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.127580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 831/1671] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:43.128415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.132928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:43.200543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 841/1672] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:42 2022] POST /identity/v3/projects => generated 373 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:26:43.204230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:43.204672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:43.206352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:43.207523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:43.307940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6f35-92ea-4dbc-95aa-4a2046e96c19 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:43.316004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.317022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.317507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.317980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.319052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.321594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:43.389498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 842/1673] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:43 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:26:43.390563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:43.413546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f19920-ce5e-4537-b838-109ae70e51c7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:43.425260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791d6c-fd12-48c2-8169-cc08daab454b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:43.445491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.447263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.448270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.448978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.450918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.455563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:43.492992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 843/1674] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:43.497350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:43.527257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:43.530710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357463-031f-4087-86f8-8f17f8f7745c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:43.542450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdb0de-0b12-47df-87f9-cc6bf61c930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.543182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdb0de-0b12-47df-87f9-cc6bf61c930d admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.545742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdb0de-0b12-47df-87f9-cc6bf61c930d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.546043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdb0de-0b12-47df-87f9-cc6bf61c930d admin admin] PATH_INFO: `/v3/projects/c2fa570c689b4bbeb899adb379714c49/users/444c24f91fb6479c98c394650840ddd6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.549848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eb4f8-9316-4d04-9fe9-875b7515ecca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.550480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb4f8-9316-4d04-9fe9-875b7515ecca service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.550758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb4f8-9316-4d04-9fe9-875b7515ecca service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.551028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eb4f8-9316-4d04-9fe9-875b7515ecca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.574790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb4f8-9316-4d04-9fe9-875b7515ecca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.576274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eb4f8-9316-4d04-9fe9-875b7515ecca service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:43.611832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 832/1675] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:43.612227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdb0de-0b12-47df-87f9-cc6bf61c930d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fa570c689b4bbeb899adb379714c49, user_id=444c24f91fb6479c98c394650840ddd6, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.633773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d079e13-4eea-4e46-88b8-f717ee4b3352 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.634102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d079e13-4eea-4e46-88b8-f717ee4b3352 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.634322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d079e13-4eea-4e46-88b8-f717ee4b3352 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.634968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdb0de-0b12-47df-87f9-cc6bf61c930d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:43.640588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 833/1676] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:26:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:26:43.667245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 844/1677] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:43 2022] PUT /identity/v3/projects/c2fa570c689b4bbeb899adb379714c49/users/444c24f91fb6479c98c394650840ddd6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:43.671341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d079e13-4eea-4e46-88b8-f717ee4b3352 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:43.690877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb123b2-d56c-4bd3-91e2-072b8aa2d3ca None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.691168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb123b2-d56c-4bd3-91e2-072b8aa2d3ca None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.691442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb123b2-d56c-4bd3-91e2-072b8aa2d3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.736715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6eb123b2-d56c-4bd3-91e2-072b8aa2d3ca None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:43.737713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6eb123b2-d56c-4bd3-91e2-072b8aa2d3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:43.873090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d079e13-4eea-4e46-88b8-f717ee4b3352 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:43.885972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.886943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.887440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.887916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.888808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.893541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:43.910518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:43.921788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 834/1678] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:43.923144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:43.943750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f8429-350d-4775-8bdc-758c9e867c3b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:43.947095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 845/1679] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:43.956216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0996df-ed2b-4512-93e9-b9797992f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:43.957192 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0996df-ed2b-4512-93e9-b9797992f7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:43.957576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0996df-ed2b-4512-93e9-b9797992f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:43.957982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0996df-ed2b-4512-93e9-b9797992f7a9 admin admin] PATH_INFO: `/v3/projects/c2fa570c689b4bbeb899adb379714c49/users/444c24f91fb6479c98c394650840ddd6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:43.962919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0996df-ed2b-4512-93e9-b9797992f7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fa570c689b4bbeb899adb379714c49, user_id=444c24f91fb6479c98c394650840ddd6, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:43.970880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0996df-ed2b-4512-93e9-b9797992f7a9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:44.008306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 835/1680] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:43 2022] PUT /identity/v3/projects/c2fa570c689b4bbeb899adb379714c49/users/444c24f91fb6479c98c394650840ddd6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:44.016274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:44.016777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:44.016857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:44.067413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fac3-7db5-49b6-8926-1bc9c9fbece7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:44.067750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fac3-7db5-49b6-8926-1bc9c9fbece7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:44.067962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fac3-7db5-49b6-8926-1bc9c9fbece7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:44.069407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 836/1681] 10.222.0.62 () {54 vars in 961 bytes} [Wed Aug 17 19:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:26:44.080062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:44.080290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:44.080572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:44.093488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] MFA Rules not processed for user `444c24f91fb6479c98c394650840ddd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:44.095495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:44.124672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:44.125938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:44.266888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 846/1682] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:44.284676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:44.285884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:44.324790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 837/1683] 10.222.0.62 () {58 vars in 1058 bytes} [Wed Aug 17 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:44.333655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:44.357287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452711b6-ce78-4af2-8947-8e8d0770806e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:44.377646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:44.379797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:44.380568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:44.380855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:44.408500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:44.412022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:44.442678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 838/1684] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:26:44.446786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea32f0e-3e26-4362-a41a-705e00427470 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:44.470229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0e54-38ea-4d29-a94d-25f39dd297b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:44.470869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0e54-38ea-4d29-a94d-25f39dd297b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:44.471154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0e54-38ea-4d29-a94d-25f39dd297b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:44.471475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0e54-38ea-4d29-a94d-25f39dd297b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:44.495718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0e54-38ea-4d29-a94d-25f39dd297b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:44.497572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0e54-38ea-4d29-a94d-25f39dd297b5 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:44.523472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 847/1685] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:44.755985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:44.772468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d050803-4eba-49bc-913a-48775c543755 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:44.785601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:44.786250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:44.786534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:44.787582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:44.798749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:44.971950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:45.009033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:45.010550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6dad6e-53d2-4c01-979a-178f56d0adf1 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:45.042385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 839/1686] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:46.348042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7204bb-1912-4b40-bc2e-f1758192dae8 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:46.348881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7204bb-1912-4b40-bc2e-f1758192dae8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:46.349286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7204bb-1912-4b40-bc2e-f1758192dae8 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:46.351792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 848/1687] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:46.437315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:46.437794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:46.437794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:46.484692 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] MFA Rules not processed for user `d1f02d8a6f8b462094e147547c7a1a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:46.485917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:46.537248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 840/1688] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:46.631694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7204bb-1912-4b40-bc2e-f1758192dae8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:46.652294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7204bb-1912-4b40-bc2e-f1758192dae8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:46.680932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:46.681907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:46.683628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:46.685524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:46.710276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:46.713918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:46.738353 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 849/1689] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:46.830747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:46.833002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:46.884480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:46.886086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:47.068013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af4e45-7bd3-417e-aa1a-8495f7fe6bd9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:47.089376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:47.090328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.090816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.091262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] PATH_INFO: `/v3/projects/27290999df9d40c9924e6a381e2159cf` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.102228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27290999df9d40c9924e6a381e2159cf)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:47.106516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:47.107913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe2aa7-b088-4a92-83b9-85ee1e9cb89d service placement] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:47.121005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:47.121987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.122381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.122763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] PATH_INFO: `/v3/users/f233f0296a5a4e16ba0a6d4a8698da65` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.126337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f233f0296a5a4e16ba0a6d4a8698da65)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:47.128434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:47.171649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:47.259837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27290999df9d40c9924e6a381e2159cf', 'request_id': 'req-1783969a-5283-4c05-8315-bf7607261905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.269855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f233f0296a5a4e16ba0a6d4a8698da65'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.283411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27290999df9d40c9924e6a381e2159cf', 'request_id': 'req-1783969a-5283-4c05-8315-bf7607261905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.331801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27290999df9d40c9924e6a381e2159cf', 'request_id': 'req-1783969a-5283-4c05-8315-bf7607261905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.340596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f233f0296a5a4e16ba0a6d4a8698da65'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.358286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f233f0296a5a4e16ba0a6d4a8698da65'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.359406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f233f0296a5a4e16ba0a6d4a8698da65'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.363162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] The token cache is being invalidate because project 27290999df9d40c9924e6a381e2159cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:26:47.364464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.367150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1783969a-5283-4c05-8315-bf7607261905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.370880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 841/1690] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:26:46 2022] DELETE /identity/v3/projects/27290999df9d40c9924e6a381e2159cf => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:47.374961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.375322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.376173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.376757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-81820922-e3c6-4b92-ade2-e81b22ac44b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f233f0296a5a4e16ba0a6d4a8698da65'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:47.391185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 850/1691] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:46 2022] DELETE /identity/v3/users/f233f0296a5a4e16ba0a6d4a8698da65 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:47.418911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:47.420400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:47.527271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.527552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.527822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.532651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 842/1692] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:47.606875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:47.608136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:47.625596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 851/1693] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:47.631369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:47.654832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564652-6415-46bb-8464-b7a2e0790981 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:47.677459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:47.687834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.688654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.691103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.697212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:47.697535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:47.699416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:47.732066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:47.740618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 843/1694] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:47.745161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:47.757595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8077f-585c-4f2f-9067-b85794a4da38 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:47.777860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:47.778494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.779324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.779324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.779654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:47.781594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:47.836907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 852/1695] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:47 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:47.840924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:47.854537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296f4b-b88b-4180-8264-5262a7467134 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:47.990866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:47.992615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:47.993120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:47.993696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:47.995241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:48.011918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:48.064463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 844/1696] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:47 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:26:48.068885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:48.080029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc8a53-4d3c-430b-9db7-b0f9f5b1f188 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:48.088813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f414-2307-492c-a679-ac41ce1a1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:48.089690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f414-2307-492c-a679-ac41ce1a1023 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.090105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f414-2307-492c-a679-ac41ce1a1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.090511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f414-2307-492c-a679-ac41ce1a1023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.091476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f414-2307-492c-a679-ac41ce1a1023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:48.093365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f414-2307-492c-a679-ac41ce1a1023 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:48.117675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 853/1697] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:48.119974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:48.156204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f7bd9-21ae-4f73-be21-334a58908f99 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.157918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e69a-5a84-4afe-9ccc-96742575c632 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:48.160093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f7bd9-21ae-4f73-be21-334a58908f99 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.160783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f7bd9-21ae-4f73-be21-334a58908f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.178115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:48.180084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.183820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.186165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.186936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:48.190913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:48.241349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 845/1698] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:26:48.242601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:48.248912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f24f7bd9-21ae-4f73-be21-334a58908f99 None None] MFA Rules not processed for user `821a1c2492294cf8a8d4f9dcf20f8860`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:48.250240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f24f7bd9-21ae-4f73-be21-334a58908f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:48.263779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff389a8-4fd0-4b32-a9f3-3e7ab33ced5a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:48.280230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafc71-313b-4d78-a316-1fa08a246c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:48.280939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafc71-313b-4d78-a316-1fa08a246c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.281490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafc71-313b-4d78-a316-1fa08a246c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.281778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafc71-313b-4d78-a316-1fa08a246c5d admin admin] PATH_INFO: `/v3/projects/2db4758280504d1e8f879bacb7c91894/users/3ae8d3056dbc4881956b0430916a9f2c/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.323977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafc71-313b-4d78-a316-1fa08a246c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db4758280504d1e8f879bacb7c91894, user_id=3ae8d3056dbc4881956b0430916a9f2c, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:48.329629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafc71-313b-4d78-a316-1fa08a246c5d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:48.371218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 846/1699] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:48 2022] PUT /identity/v3/projects/2db4758280504d1e8f879bacb7c91894/users/3ae8d3056dbc4881956b0430916a9f2c/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:48.384412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.385020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.385390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.458503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 854/1700] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:48.465340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] MFA Rules not processed for user `3ae8d3056dbc4881956b0430916a9f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:48.467906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:48.469665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.470148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.470581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.506459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] MFA Rules not processed for user `821a1c2492294cf8a8d4f9dcf20f8860`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:48.508860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:48.570820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:48.626115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 855/1701] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:48.636217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:48.639460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:48.643833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 847/1702] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:26:48.649085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:48.809546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:48.883488 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939e481-638d-4553-86b2-ecf5b8429fed None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:48.890266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b95a0-6933-4cd9-a5e2-1f9ec2381a6f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:48.897039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:48.900499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.901351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.901645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.902837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:48.906797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:48.907492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:48.907780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:48.909797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:48.910139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:48.943111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:48.946458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:48.982126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 856/1703] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:48.997708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:48.999391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 848/1704] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:48 2022] POST /identity/v3/projects => generated 393 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:49.022858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bab46-e2b9-4a63-848c-ad1c8059e06c service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:49.250903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:49.252133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.252707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.253070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.253938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:49.260500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:49.301899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 857/1705] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:48 2022] POST /identity/v3/users => generated 303 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:49.307021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:49.321181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7b912-0cfa-4a76-91a6-bde48d4f6e3a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:49.326369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:49.327094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.327445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.327785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.328548 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:49.332495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:49.350757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 849/1706] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:49.357826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:49.386028 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8c85-11bf-4484-ad6f-7876602a68de admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:49.398437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:49.399960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.401354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.401896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] PATH_INFO: `/v3/projects/06c3f9699a4e490288fa77788bd6d44d/users/d0bf3dcb4b594257b9837ad5d6b692ec/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.443209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c3f9699a4e490288fa77788bd6d44d, user_id=d0bf3dcb4b594257b9837ad5d6b692ec, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:49.445878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:49.504558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 858/1707] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:49 2022] PUT /identity/v3/projects/06c3f9699a4e490288fa77788bd6d44d/users/d0bf3dcb4b594257b9837ad5d6b692ec/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:49.509305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:49.540288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad0ad-9bd3-43ff-951d-2b6cc703fb51 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:49.559349 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:49.565580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:49.700286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:49.751846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8735e1-cb32-496e-a480-29abaaa3f949 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:49.763162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:49.763845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.764127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.764498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] PATH_INFO: `/v3/projects/48a18f6661d64c7bb97a8a4215c7e0fd` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.768510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a18f6661d64c7bb97a8a4215c7e0fd)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:49.770175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: WARNING py.warnings [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:26:49.770175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: warnings.warn(msg) Aug 17 19:26:49.770175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: Aug 17 19:26:49.771853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:49.785072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:49.785707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.785987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.786258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.786897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:49.789090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:49.818172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 850/1708] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:49.818172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:49.841760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38b106-0f79-4e04-ad7a-16112f4ac864 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:49.855048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2a29a-be32-4cce-b958-9468b9ca4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:49.855732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a29a-be32-4cce-b958-9468b9ca4adf admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.856008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a29a-be32-4cce-b958-9468b9ca4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.856299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2a29a-be32-4cce-b958-9468b9ca4adf admin admin] PATH_INFO: `/v3/projects/06c3f9699a4e490288fa77788bd6d44d/users/d0bf3dcb4b594257b9837ad5d6b692ec/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.861262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2a29a-be32-4cce-b958-9468b9ca4adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c3f9699a4e490288fa77788bd6d44d, user_id=d0bf3dcb4b594257b9837ad5d6b692ec, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:49.863966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2a29a-be32-4cce-b958-9468b9ca4adf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:49.905359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 851/1709] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:49 2022] PUT /identity/v3/projects/06c3f9699a4e490288fa77788bd6d44d/users/d0bf3dcb4b594257b9837ad5d6b692ec/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:49.907674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:49.907989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:49.908302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:49.917999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a18f6661d64c7bb97a8a4215c7e0fd', 'request_id': 'req-ec4346ff-675c-4e79-8866-ae3fb10140b4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:49.945069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a18f6661d64c7bb97a8a4215c7e0fd', 'request_id': 'req-ec4346ff-675c-4e79-8866-ae3fb10140b4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:49.958556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a18f6661d64c7bb97a8a4215c7e0fd', 'request_id': 'req-ec4346ff-675c-4e79-8866-ae3fb10140b4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:49.983511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] MFA Rules not processed for user `d0bf3dcb4b594257b9837ad5d6b692ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:49.984928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:50.037377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] The token cache is being invalidate because project 48a18f6661d64c7bb97a8a4215c7e0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:26:50.038754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.040969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.044762 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 859/1710] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:26:49 2022] DELETE /identity/v3/projects/48a18f6661d64c7bb97a8a4215c7e0fd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:50.048460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:50.051197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:50.190594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4346ff-675c-4e79-8866-ae3fb10140b4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:50.204890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 852/1711] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:26:50.223335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:50.229883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:50.281589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:50.282257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:50.282540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:50.282841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] PATH_INFO: `/v3/users/57cd70a321ad4e7e97e13cc390fa4e77` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:50.284723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cd70a321ad4e7e97e13cc390fa4e77)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:50.287032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:50.335918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:50.358466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:50.373158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbc284-160f-4a80-8629-e87ae7f5276f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:50.382060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7ce4-4772-405e-ba23-b5e6dbed24ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:50.382653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7ce4-4772-405e-ba23-b5e6dbed24ec service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:50.382933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7ce4-4772-405e-ba23-b5e6dbed24ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:50.383200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7ce4-4772-405e-ba23-b5e6dbed24ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:50.400622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f7ce4-4772-405e-ba23-b5e6dbed24ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:50.408220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f7ce4-4772-405e-ba23-b5e6dbed24ec service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:50.426784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 853/1712] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:50.430865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8399-4e34-4a81-9a64-c3384847de01 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:50.431142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8399-4e34-4a81-9a64-c3384847de01 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:50.432469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8399-4e34-4a81-9a64-c3384847de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:50.488625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cd70a321ad4e7e97e13cc390fa4e77'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.539408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cd70a321ad4e7e97e13cc390fa4e77'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.561737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-512b8399-4e34-4a81-9a64-c3384847de01 None None] MFA Rules not processed for user `60612f26098a404f9d1323cc95ee6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:50.562999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-512b8399-4e34-4a81-9a64-c3384847de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:50.565646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cd70a321ad4e7e97e13cc390fa4e77'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.566530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cd70a321ad4e7e97e13cc390fa4e77'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.583959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cd70a321ad4e7e97e13cc390fa4e77'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:50.606843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 860/1713] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:50 2022] DELETE /identity/v3/users/57cd70a321ad4e7e97e13cc390fa4e77 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:50.610177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:50.614043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:50.787420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 854/1714] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:50.788600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a93f-a45e-40c1-a886-a2f2663af520 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:50.788944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a93f-a45e-40c1-a886-a2f2663af520 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:50.789184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a93f-a45e-40c1-a886-a2f2663af520 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:50.790508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 855/1715] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 17 19:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:50.800233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:50.800559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:50.800803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:50.893274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a511fb-17d8-4cac-9c7f-3b7a40055e98 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:50.904700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:50.906411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:50.906769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:50.907235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:50.916866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:50.930247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:50.937063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:51.107512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:51.110447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:51.133605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 861/1716] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:51.134536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:51.137095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 856/1717] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:26:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:51.140171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:51.171200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:51.172932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:51.187077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdd8d-a78a-4afd-ae59-0253fad8c486 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:51.206934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcd84e-1650-4430-8329-1093617df6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:51.207572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcd84e-1650-4430-8329-1093617df6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:51.207849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcd84e-1650-4430-8329-1093617df6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:51.208138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcd84e-1650-4430-8329-1093617df6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:51.244883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcd84e-1650-4430-8329-1093617df6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:51.246092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcd84e-1650-4430-8329-1093617df6a5 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:51.282247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 857/1718] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:51.285746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400912a6-e7a3-4e47-8959-326287e279af None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:51.286053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400912a6-e7a3-4e47-8959-326287e279af None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:51.286322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400912a6-e7a3-4e47-8959-326287e279af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:51.313499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:51.380395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-400912a6-e7a3-4e47-8959-326287e279af None None] MFA Rules not processed for user `95df35149a7842c2b8908aeb56516d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:51.382539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-400912a6-e7a3-4e47-8959-326287e279af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:51.401783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef73b9-ac4a-4a9e-b570-8c9ae631b3de service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:51.417779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:51.418454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:51.418784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:51.419351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:51.502723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:51.651033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 858/1719] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:51.656871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e346-6dbb-44c4-90ea-e4061de909a3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:51.657131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:51.657965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e346-6dbb-44c4-90ea-e4061de909a3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:51.658433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e346-6dbb-44c4-90ea-e4061de909a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:51.660600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:51.693449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 862/1720] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:51.694740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:51.702214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:51.743385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9d27e346-6dbb-44c4-90ea-e4061de909a3 None None] MFA Rules not processed for user `4bf81750d77c422f8d99a0b7cbeea87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:51.745108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9d27e346-6dbb-44c4-90ea-e4061de909a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:51.861476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a13a14-d490-49a1-af0b-f90ac0c8b1f6 service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:51.879669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:51.880443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:51.880770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:51.881052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] PATH_INFO: `/v3/projects/f6e40886aaf44df69dcb2a266a5c2f9d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:51.882914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e40886aaf44df69dcb2a266a5c2f9d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:51.887523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.008681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 859/1721] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:52.008681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.008681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.008681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.032998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e40886aaf44df69dcb2a266a5c2f9d', 'request_id': 'req-7e829b09-fb5e-4575-82cb-96f6506a4d79'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:52.050246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e40886aaf44df69dcb2a266a5c2f9d', 'request_id': 'req-7e829b09-fb5e-4575-82cb-96f6506a4d79'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:52.067389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e40886aaf44df69dcb2a266a5c2f9d', 'request_id': 'req-7e829b09-fb5e-4575-82cb-96f6506a4d79'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:52.088087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] MFA Rules not processed for user `95df35149a7842c2b8908aeb56516d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:52.089485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.119048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] The token cache is being invalidate because project f6e40886aaf44df69dcb2a266a5c2f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:26:52.119418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:52.121233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7e829b09-fb5e-4575-82cb-96f6506a4d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:52.128958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 863/1722] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:26:51 2022] DELETE /identity/v3/projects/f6e40886aaf44df69dcb2a266a5c2f9d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:52.130991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fb23-a6e5-4907-a69d-be9b5d99e60d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.133691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fb23-a6e5-4907-a69d-be9b5d99e60d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.134067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fb23-a6e5-4907-a69d-be9b5d99e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.185946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6e14fb23-a6e5-4907-a69d-be9b5d99e60d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:52.190270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6e14fb23-a6e5-4907-a69d-be9b5d99e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.210144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:52.294944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 860/1723] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:52.355284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.356947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.367706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 864/1724] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:52.376375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.376883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.377735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.451840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:52.453251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.472670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 865/1725] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:52.477464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.493414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9215f-6aca-4535-bb89-50e52beaacd8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.503266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.504218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.504595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.504939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.506436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:26:52.506932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.509103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.532929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6187d00-fc10-4f84-a38b-9f682ce34b74 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.541143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 866/1726] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:26:52.541143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.541389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.541389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.541389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.541640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.541722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.543078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.556459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.558270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.585279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 861/1727] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:52.586144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.607852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354499-632b-497b-8814-95dbe06a8a64 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.613785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.614653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.614938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.615214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.615901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.618516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.624986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:52.668281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 862/1728] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:52 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:52.673225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.689275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842aba3d-c58e-4830-9124-e91a9c4fbdc1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.770493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fb700-6c22-431a-a24f-74f478d44fff admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.777770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7cb5-a81f-407d-8e41-63dfaaad6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.778398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7cb5-a81f-407d-8e41-63dfaaad6843 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.778732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7cb5-a81f-407d-8e41-63dfaaad6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.779062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7cb5-a81f-407d-8e41-63dfaaad6843 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.780560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b7cb5-a81f-407d-8e41-63dfaaad6843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.783557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b7cb5-a81f-407d-8e41-63dfaaad6843 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.812219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.814948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.815347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.815540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.818014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.821862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 863/1729] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:52 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:52.821862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a995-f88f-4329-9065-2edbf3634fa5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.821862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a995-f88f-4329-9065-2edbf3634fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.822194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a995-f88f-4329-9065-2edbf3634fa5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.823971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 864/1730] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 17 19:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:26:52.831219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a995-f88f-4329-9065-2edbf3634fa5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.841024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.842722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e025b-6a55-4acf-9655-df60af4e2c64 service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.852986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a995-f88f-4329-9065-2edbf3634fa5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.855526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 867/1731] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:52.857041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de0d7-d139-4b80-9ed6-ba5c5dd83df2 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.857316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de0d7-d139-4b80-9ed6-ba5c5dd83df2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.857715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de0d7-d139-4b80-9ed6-ba5c5dd83df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.860951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.861121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.861489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.861802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.862663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.864671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.888300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 865/1732] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:52.890650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-725de0d7-d139-4b80-9ed6-ba5c5dd83df2 None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:52.894287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-725de0d7-d139-4b80-9ed6-ba5c5dd83df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:52.894934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:52.926722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c62ee-de4e-49aa-aaf4-2dee53dd5d83 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:52.940601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:52.946946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:52.947886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:52.948767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:52.951065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:52.959058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:52.982523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:52.992229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 866/1733] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:52.994474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:53.058070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7345982-31ea-456d-bcb6-6ece5b0055ff admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:53.072607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:53.073836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:53.075159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:53.075604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] PATH_INFO: `/v3/projects/9e1258c1175e4910a4153384614df370/users/1fa0ebd896784ddbb5c34ea5df30b5a4/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:53.119039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1258c1175e4910a4153384614df370, user_id=1fa0ebd896784ddbb5c34ea5df30b5a4, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:53.119563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 868/1734] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:26:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:53.122318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:53.154958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 867/1735] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:52 2022] PUT /identity/v3/projects/9e1258c1175e4910a4153384614df370/users/1fa0ebd896784ddbb5c34ea5df30b5a4/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:53.171217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb489-430d-472e-9248-ec558075ffde None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:53.171907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb489-430d-472e-9248-ec558075ffde None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:53.172415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb489-430d-472e-9248-ec558075ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:53.227433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f42fb489-430d-472e-9248-ec558075ffde None None] MFA Rules not processed for user `1fa0ebd896784ddbb5c34ea5df30b5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:53.229436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f42fb489-430d-472e-9248-ec558075ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:53.390963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 869/1736] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:53.392541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:53.465725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb489-430d-472e-9248-ec558075ffde None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:53.467795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f42fb489-430d-472e-9248-ec558075ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:53.526112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549db7-c50a-46b7-bbf7-5da044c5b7ce admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:53.543151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:53.544499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:53.544850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:53.545126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:53.545778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:53.561381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:53.661307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 868/1737] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:26:53 2022] POST /identity/v3/projects => generated 363 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:26:53.665342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:53.696552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb489-430d-472e-9248-ec558075ffde None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:53.698481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:53.845788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7dd6-edbe-4fe7-8837-0995c2021019 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:53.859892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:53.862399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:53.862779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:53.863057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:53.865190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:53.870980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:53.884067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:53.884853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:53.885851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:53.885971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:53.898626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:53.900382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:53.913262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 870/1738] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:53.916528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 869/1739] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:26:53 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:26:53.930366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:53.966910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87d02-d519-4252-b468-3e0283f7e6f3 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:53.981698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:53.982708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:53.983052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:53.983472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:53.985414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:53.989399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:54.027685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:54.028293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 871/1740] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:54.040221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fefb34-3f8d-4b7b-b04b-e706e5c677f8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:54.057598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:54.060082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:54.061357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:54.061650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] PATH_INFO: `/v3/projects/23cad03252d44f929e09a61b15f18b1d/users/8481c4b805944ee28efb08c6fdf789e7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:54.105649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cad03252d44f929e09a61b15f18b1d, user_id=8481c4b805944ee28efb08c6fdf789e7, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:54.112893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:54.147275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 870/1741] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:54 2022] PUT /identity/v3/projects/23cad03252d44f929e09a61b15f18b1d/users/8481c4b805944ee28efb08c6fdf789e7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:54.154620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:54.189118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212e37-8137-47d9-9f42-90381fd5f831 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:54.222395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:54.415783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dbf9d-d349-4e52-ac46-a50aad7c8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:54.416910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dbf9d-d349-4e52-ac46-a50aad7c8235 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:54.418806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dbf9d-d349-4e52-ac46-a50aad7c8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:54.420214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dbf9d-d349-4e52-ac46-a50aad7c8235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:54.424545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dbf9d-d349-4e52-ac46-a50aad7c8235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:54.426830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dbf9d-d349-4e52-ac46-a50aad7c8235 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:54.461290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 872/1742] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:26:54.464581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:54.487360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d28cd-25d5-40b5-aa98-fa833bbcae76 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:54.502481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:54.503298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:54.504420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:54.505183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] PATH_INFO: `/v3/projects/23cad03252d44f929e09a61b15f18b1d/users/8481c4b805944ee28efb08c6fdf789e7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:54.510864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cad03252d44f929e09a61b15f18b1d, user_id=8481c4b805944ee28efb08c6fdf789e7, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:54.517424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:54.567606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 871/1743] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:26:54 2022] PUT /identity/v3/projects/23cad03252d44f929e09a61b15f18b1d/users/8481c4b805944ee28efb08c6fdf789e7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:54.570039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:54.570351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:54.570747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:54.653712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] MFA Rules not processed for user `8481c4b805944ee28efb08c6fdf789e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:54.654767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:54.893191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 873/1744] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:54.919476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:54.921427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:55.149622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aec198-bb47-4a65-95c1-1f6f2e2c86b0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:55.159979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d3b4-e5e9-498c-b6ad-4af27001397b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:55.160661 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d3b4-e5e9-498c-b6ad-4af27001397b service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:55.160938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d3b4-e5e9-498c-b6ad-4af27001397b service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:55.162418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d3b4-e5e9-498c-b6ad-4af27001397b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:55.189587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d3b4-e5e9-498c-b6ad-4af27001397b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:55.191039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d3b4-e5e9-498c-b6ad-4af27001397b service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:55.206479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 872/1745] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:55.590987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:55.592830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:55.614621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371e77a-519d-4658-acb8-3351c693a0b1 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:55.620486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa6dc3-ccc4-43b2-b014-813c632af08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:55.621503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa6dc3-ccc4-43b2-b014-813c632af08e service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:55.622282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa6dc3-ccc4-43b2-b014-813c632af08e service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:55.622805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa6dc3-ccc4-43b2-b014-813c632af08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:55.867207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60c70-49b2-4898-ba27-717f54881677 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:55.867786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60c70-49b2-4898-ba27-717f54881677 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:55.876357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60c70-49b2-4898-ba27-717f54881677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:55.899694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa6dc3-ccc4-43b2-b014-813c632af08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:55.901568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa6dc3-ccc4-43b2-b014-813c632af08e service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:55.952453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 874/1746] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:55.972911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4de60c70-49b2-4898-ba27-717f54881677 None None] MFA Rules not processed for user `95df35149a7842c2b8908aeb56516d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:55.978683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4de60c70-49b2-4898-ba27-717f54881677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:56.107929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:56.108219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:56.108532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:56.144457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] MFA Rules not processed for user `60612f26098a404f9d1323cc95ee6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:56.145695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:56.173970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 873/1747] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:56.203444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:56.261284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 875/1748] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:57.669116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:57.670215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:57.670739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:57.734420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:57.878413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:57.890042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:57.965380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:57.967329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:58.305575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a46d43-f904-44cd-b0e3-340e377cffc5 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:58.310313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 874/1749] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:26:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 642 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:58.311345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:58.329522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:58.351857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:58.354972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:58.357970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:58.360819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] PATH_INFO: `/v3/users/3ae8d3056dbc4881956b0430916a9f2c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:58.374340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae8d3056dbc4881956b0430916a9f2c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:58.376398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:58.418465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88ecac-8826-45bd-8231-47cc297c5c83 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:58.442162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:58.447412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:58.448766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:58.451573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] PATH_INFO: `/v3/users/b6abbb7d1e594809876398462408bdfc` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:58.456478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6abbb7d1e594809876398462408bdfc)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:58.478345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:58.598736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae8d3056dbc4881956b0430916a9f2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.671927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae8d3056dbc4881956b0430916a9f2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.688980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae8d3056dbc4881956b0430916a9f2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.689884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae8d3056dbc4881956b0430916a9f2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.704407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6abbb7d1e594809876398462408bdfc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.709562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0483216-ffc1-4583-9d73-e39befdeaa1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae8d3056dbc4881956b0430916a9f2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.723261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 876/1750] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:57 2022] DELETE /identity/v3/users/3ae8d3056dbc4881956b0430916a9f2c => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:26:58.729675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6abbb7d1e594809876398462408bdfc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.730722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ff0f2-fa5a-4928-9498-25634a3966ad None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:58.731231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ff0f2-fa5a-4928-9498-25634a3966ad None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:58.731746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ff0f2-fa5a-4928-9498-25634a3966ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:58.731964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6abbb7d1e594809876398462408bdfc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.732996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6abbb7d1e594809876398462408bdfc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.758212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6abbb7d1e594809876398462408bdfc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:26:58.774566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-419ff0f2-fa5a-4928-9498-25634a3966ad None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:58.776156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-419ff0f2-fa5a-4928-9498-25634a3966ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:58.865308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 875/1751] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:26:58 2022] DELETE /identity/v3/users/b6abbb7d1e594809876398462408bdfc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:26:58.869682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:58.872233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:59.098623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:59.141445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 877/1752] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:59.143662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:59.144477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:59.145959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:59.205591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:59.210072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:59.252142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:59.379575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a14a04-f6bd-47ca-a30d-bb42ca3458c8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:59.405515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:59.409663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:59.409928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:59.410182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:59.419074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:59.478221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 878/1753] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:59.486205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:59.489384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:59.635917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:59.639090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:59.696089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 876/1754] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:26:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:26:59.699087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:59.704125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2d9f-289e-4d1a-8e00-d7c84720b1ee None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:59.705328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:59.720213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:59.720654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:59.722102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:59.722523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:59.744851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20476-f019-4e70-af57-cfbeee65ad3a service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:59.758580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:59.763150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8afc0-614b-4863-b33b-f2f004da9fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:59.764513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:59.765340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8afc0-614b-4863-b33b-f2f004da9fba service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:59.770616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8afc0-614b-4863-b33b-f2f004da9fba service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:59.771209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8afc0-614b-4863-b33b-f2f004da9fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:59.805909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 879/1755] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:59.811787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8afc0-614b-4863-b33b-f2f004da9fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:59.814926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8afc0-614b-4863-b33b-f2f004da9fba service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:59.886621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 877/1756] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:00.747209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:00.748752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:00.782137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35182e-3cc1-4fcd-8413-f1ed0d9026fc service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:00.828174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:00.829016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:00.829302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:00.829576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] PATH_INFO: `/v3/users/1fa0ebd896784ddbb5c34ea5df30b5a4` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:00.839578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa0ebd896784ddbb5c34ea5df30b5a4)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:00.841731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:01.033891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa0ebd896784ddbb5c34ea5df30b5a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:01.127328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa0ebd896784ddbb5c34ea5df30b5a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:01.151061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa0ebd896784ddbb5c34ea5df30b5a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:01.152627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa0ebd896784ddbb5c34ea5df30b5a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:01.195491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa0ebd896784ddbb5c34ea5df30b5a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:01.245416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 880/1757] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:00 2022] DELETE /identity/v3/users/1fa0ebd896784ddbb5c34ea5df30b5a4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:01.246838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be35c8-0858-4aaa-9c0a-8576af69766c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:01.253621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be35c8-0858-4aaa-9c0a-8576af69766c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:01.254227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be35c8-0858-4aaa-9c0a-8576af69766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:01.350899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-21be35c8-0858-4aaa-9c0a-8576af69766c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:01.363254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-21be35c8-0858-4aaa-9c0a-8576af69766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:01.592633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 878/1758] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:01.704617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:01.706111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:01.757592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:01.921170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe550f-58fd-41a9-b242-6216a0278fe6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:01.930525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:01.953895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:01.957286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:01.960351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:01.996205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:02.001205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:02.017122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 881/1759] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:02.443305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:02.444571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:02.444571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:02.504908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:02.511184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:02.535296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 879/1760] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 17 19:27:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:02.755541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:02.765726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c733c5-7f56-44fd-8f71-e96f17e87bf4 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:02.787985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:02.793849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:02.794201 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:02.794489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:02.829941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:02.831420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:02.879023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 882/1761] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:03.475925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:03.479829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:03.521971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51058a3a-74d4-4365-9574-7d54c54046df None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:03.541258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:03.545905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:03.547701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:03.549524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] PATH_INFO: `/v3/projects/dbcd4079068e43699502d80149889b5c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:03.555042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcd4079068e43699502d80149889b5c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:03.562948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:03.706127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcd4079068e43699502d80149889b5c', 'request_id': 'req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:03.724009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcd4079068e43699502d80149889b5c', 'request_id': 'req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:03.727747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:03.741521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcd4079068e43699502d80149889b5c', 'request_id': 'req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:03.772546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] The token cache is being invalidate because project dbcd4079068e43699502d80149889b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:03.772876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:03.776015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:03.781191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 880/1762] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:03 2022] DELETE /identity/v3/projects/dbcd4079068e43699502d80149889b5c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:03.785269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:03.824288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299c583-d81d-4d03-ae9e-e553cc3f27a1 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:04.043518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:04.045276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:04.045922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:04.046772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] PATH_INFO: `/v3/users/7d0a1cba69da4495b270b4843f1476aa` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:04.048458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0a1cba69da4495b270b4843f1476aa)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:04.065454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:04.188326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0a1cba69da4495b270b4843f1476aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.219728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0a1cba69da4495b270b4843f1476aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.236503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0a1cba69da4495b270b4843f1476aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.237454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0a1cba69da4495b270b4843f1476aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.253603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0a1cba69da4495b270b4843f1476aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.276489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 883/1763] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:03 2022] DELETE /identity/v3/users/7d0a1cba69da4495b270b4843f1476aa => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:04.299814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:04.301736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:04.325150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e52a-ea71-4d7c-adb3-ffbbcc3fae98 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:04.531962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:04.535601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:04.537227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:04.543196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] PATH_INFO: `/v3/projects/9e1258c1175e4910a4153384614df370` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:04.549052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1258c1175e4910a4153384614df370)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:04.563149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:04.799183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1258c1175e4910a4153384614df370', 'request_id': 'req-13b374f3-87ad-4ed9-91f9-cac5c56cb353'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.820231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1258c1175e4910a4153384614df370', 'request_id': 'req-13b374f3-87ad-4ed9-91f9-cac5c56cb353'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.829574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1258c1175e4910a4153384614df370', 'request_id': 'req-13b374f3-87ad-4ed9-91f9-cac5c56cb353'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.866868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] The token cache is being invalidate because project 9e1258c1175e4910a4153384614df370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:04.867434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.869442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:04.872716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 881/1764] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:04 2022] DELETE /identity/v3/projects/9e1258c1175e4910a4153384614df370 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:04.876667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:04.878202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:04.903536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265fe0-1248-4120-ae06-dd218c92efcc admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:04.937054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:05.132210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:05.133698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:05.133968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:05.134295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] PATH_INFO: `/v3/users/8481c4b805944ee28efb08c6fdf789e7` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:05.138741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8481c4b805944ee28efb08c6fdf789e7)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:05.152553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:05.344063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8481c4b805944ee28efb08c6fdf789e7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:05.398531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8481c4b805944ee28efb08c6fdf789e7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:05.416179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8481c4b805944ee28efb08c6fdf789e7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:05.416768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8481c4b805944ee28efb08c6fdf789e7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:05.438404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-84492e35-fa4a-4d8b-a393-f95e0ababe42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8481c4b805944ee28efb08c6fdf789e7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:05.451764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 884/1765] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:04 2022] DELETE /identity/v3/users/8481c4b805944ee28efb08c6fdf789e7 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:06.011335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:06.013345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:06.044234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b374f3-87ad-4ed9-91f9-cac5c56cb353 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:06.261676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:06.263812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:06.267218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:06.267865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] PATH_INFO: `/v3/projects/2251275cc8714f13a31da10d72bd7ae2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:06.275034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2251275cc8714f13a31da10d72bd7ae2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:06.281843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:06.372437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:06.490710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2251275cc8714f13a31da10d72bd7ae2', 'request_id': 'req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:06.514127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2251275cc8714f13a31da10d72bd7ae2', 'request_id': 'req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:06.544643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2251275cc8714f13a31da10d72bd7ae2', 'request_id': 'req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:06.582407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] The token cache is being invalidate because project 2251275cc8714f13a31da10d72bd7ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:06.588998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:06.591698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6e60e8a-cbf0-49df-afa3-2d160f4ad54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:06.602751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 882/1766] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:06 2022] DELETE /identity/v3/projects/2251275cc8714f13a31da10d72bd7ae2 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:06.607499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:06.608054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:06.608054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:06.691449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:06.697464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:07.002382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 885/1767] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:07.011936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.012438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.012734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.058744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:07.060085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:07.088468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 883/1768] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:07.090013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.113671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06f982-b254-4f80-92fb-fc82fb2e5ca0 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.144486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.149051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.150706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.151279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.153730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:07.156374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.165504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.171212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.173151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:07.207171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 886/1769] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:07.209845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.211493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75984914-97f4-4868-8e6f-9fe7c53f8c83 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.226224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.228514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.229183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.229674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] PATH_INFO: `/v3/projects/2db4758280504d1e8f879bacb7c91894` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.233878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db4758280504d1e8f879bacb7c91894)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.235174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e824-80d1-473d-a265-f2c95dbb2791 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.237579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.250650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.251495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.251861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.252229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.253956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.258899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.323296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 887/1770] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:07 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:07.327597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.341138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:07.449559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db4758280504d1e8f879bacb7c91894', 'request_id': 'req-33d2f592-d78a-41dc-af7f-f40addfee803'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:07.479535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db4758280504d1e8f879bacb7c91894', 'request_id': 'req-33d2f592-d78a-41dc-af7f-f40addfee803'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:07.484355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b81b53-a49c-4962-92e6-8515c5d1f0dd admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.503950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db4758280504d1e8f879bacb7c91894', 'request_id': 'req-33d2f592-d78a-41dc-af7f-f40addfee803'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:07.546264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] The token cache is being invalidate because project 2db4758280504d1e8f879bacb7c91894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:07.548182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:07.550160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:07.558731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 884/1771] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:07 2022] DELETE /identity/v3/projects/2db4758280504d1e8f879bacb7c91894 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:07.561048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.564623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:07.627808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.630317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.630632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.631004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.631651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.637714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.686559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 888/1772] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:07 2022] POST /identity/v3/users => generated 284 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:07.688354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.691081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:07.716844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9ffb1-4d34-4c5e-9a7d-fc73fe30bc76 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.733023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.733669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.733954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.734241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.735184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.737822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.769233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 889/1773] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:07.770294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.797213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac9a1e-3735-4f8a-a2b4-c3dfe7e6c891 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.807166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.807954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.808342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.808620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.809285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.811081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.826366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 890/1774] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:07.830162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:07.849883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90b26-f1b1-4b3b-92fb-40e7e6fadd88 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.856597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c39ba-33b1-4396-ac99-cbe56ed84380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.858422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c39ba-33b1-4396-ac99-cbe56ed84380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.858803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c39ba-33b1-4396-ac99-cbe56ed84380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.859498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c39ba-33b1-4396-ac99-cbe56ed84380 admin admin] PATH_INFO: `/v3/projects/f35ce13bb53b4357a87042445f7c31d8/users/2548c743d25d4e75af241beeae1bacfb/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.882456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c39ba-33b1-4396-ac99-cbe56ed84380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35ce13bb53b4357a87042445f7c31d8, user_id=2548c743d25d4e75af241beeae1bacfb, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.889393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c39ba-33b1-4396-ac99-cbe56ed84380 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.889592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f592-d78a-41dc-af7f-f40addfee803 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:07.920289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 891/1775] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:07 2022] PUT /identity/v3/projects/f35ce13bb53b4357a87042445f7c31d8/users/2548c743d25d4e75af241beeae1bacfb/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:07.925602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:07.926133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.926514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.926901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] PATH_INFO: `/v3/users/d0bf3dcb4b594257b9837ad5d6b692ec` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.928643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:07.929152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:07.929348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bf3dcb4b594257b9837ad5d6b692ec)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:07.929737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:07.931462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:07.960919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:07.981405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] MFA Rules not processed for user `2548c743d25d4e75af241beeae1bacfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:07.983633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:08.030123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bf3dcb4b594257b9837ad5d6b692ec'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:08.050033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bf3dcb4b594257b9837ad5d6b692ec'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:08.051244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bf3dcb4b594257b9837ad5d6b692ec'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:08.052332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bf3dcb4b594257b9837ad5d6b692ec'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:08.063013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:08.076780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bf3dcb4b594257b9837ad5d6b692ec'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:08.116870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 892/1776] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:08.119777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 885/1777] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:07 2022] DELETE /identity/v3/users/d0bf3dcb4b594257b9837ad5d6b692ec => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:08.121215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:08.125420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:08.341618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52087b1-7253-44b5-a7a2-7c86f4ae6be7 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:08.514650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:08.515546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:08.515739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:08.516089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:08.516773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:08.519097 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:08.600517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:08.601497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 893/1778] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:08 2022] POST /identity/v3/projects => generated 365 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:08.615886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd417e04-4e1b-45ba-8032-ba45f3ba7a25 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:08.832002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:08.837332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:08.841531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:08.842014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:08.842881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:08.846424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:08.936405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:08.947009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 886/1779] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:08 2022] POST /identity/v3/users => generated 289 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:08.956523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731913d1-b5ad-4116-bae1-4516e29db8c1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:08.976350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:08.982094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:08.982094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:08.982094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:08.982094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:08.986415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:09.020566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 894/1780] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:09.022915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:09.043643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaabea9-da1b-400f-993f-a763aab7f266 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:09.057301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:09.058284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:09.058721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:09.059230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] PATH_INFO: `/v3/projects/d6814dccc77643d38503b08dfcd6eec1/users/cd42a0503e054e5c872b78968b2ee3e4/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:09.106103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6814dccc77643d38503b08dfcd6eec1, user_id=cd42a0503e054e5c872b78968b2ee3e4, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:09.112549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:09.145695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 887/1781] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:09 2022] PUT /identity/v3/projects/d6814dccc77643d38503b08dfcd6eec1/users/cd42a0503e054e5c872b78968b2ee3e4/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:09.150725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:09.184636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf208df-1b2b-40c7-b8d2-64b7b1b08f61 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:09.362691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374dba1-1ae9-4e46-9ec3-cd1794a57fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:09.363274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374dba1-1ae9-4e46-9ec3-cd1794a57fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:09.363557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374dba1-1ae9-4e46-9ec3-cd1794a57fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:09.363827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374dba1-1ae9-4e46-9ec3-cd1794a57fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:09.364540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374dba1-1ae9-4e46-9ec3-cd1794a57fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:09.366866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374dba1-1ae9-4e46-9ec3-cd1794a57fb0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:09.407311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:09.413716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 895/1782] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:09.438606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b29b8-56a9-4a6f-bfbc-1959b93595f3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:09.452709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a21f3-5116-4928-bf4c-550589255cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:09.455504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a21f3-5116-4928-bf4c-550589255cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:09.456308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a21f3-5116-4928-bf4c-550589255cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:09.457381 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a21f3-5116-4928-bf4c-550589255cac admin admin] PATH_INFO: `/v3/projects/d6814dccc77643d38503b08dfcd6eec1/users/cd42a0503e054e5c872b78968b2ee3e4/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:09.463543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a21f3-5116-4928-bf4c-550589255cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6814dccc77643d38503b08dfcd6eec1, user_id=cd42a0503e054e5c872b78968b2ee3e4, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:09.473516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a21f3-5116-4928-bf4c-550589255cac admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:09.515000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 888/1783] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:09 2022] PUT /identity/v3/projects/d6814dccc77643d38503b08dfcd6eec1/users/cd42a0503e054e5c872b78968b2ee3e4/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:09.517086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:09.517576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:09.518119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:09.535899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:09.629180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] MFA Rules not processed for user `cd42a0503e054e5c872b78968b2ee3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:09.630344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:09.643990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54ca3f-964a-4b82-b398-4a4465d5e67c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:09.644542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54ca3f-964a-4b82-b398-4a4465d5e67c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:09.644900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54ca3f-964a-4b82-b398-4a4465d5e67c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:09.647225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 889/1784] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:27:09.655735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:09.657143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:09.657531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:09.804806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:09.805828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:09.940627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:09.958840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 896/1785] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:09.962134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:09.969835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:10.041636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 890/1786] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:10.122227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527683-d912-4bf5-9426-02eac435ab14 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:10.127406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:10.128317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:10.128863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:10.129301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:10.143332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:10.145881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:10.171175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 897/1787] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:10.236841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:10.238599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:10.258858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d5a60-d12f-4bdd-8768-e3426c18e8fb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:10.262930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ae61e-6076-4637-82d5-95cc3ba70768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:10.263564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ae61e-6076-4637-82d5-95cc3ba70768 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:10.264049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ae61e-6076-4637-82d5-95cc3ba70768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:10.264162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ae61e-6076-4637-82d5-95cc3ba70768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:10.414990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:10.416681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:10.425907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ae61e-6076-4637-82d5-95cc3ba70768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:10.431413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ae61e-6076-4637-82d5-95cc3ba70768 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:10.500508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 891/1788] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:10.635409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3282f4-cb54-4ca5-98b2-5313f394074d service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:10.650915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:10.652199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:10.654563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:10.655047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] PATH_INFO: `/v3/projects/23cad03252d44f929e09a61b15f18b1d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:10.659848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cad03252d44f929e09a61b15f18b1d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:10.665331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:10.767510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:10.796894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cad03252d44f929e09a61b15f18b1d', 'request_id': 'req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:10.815542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cad03252d44f929e09a61b15f18b1d', 'request_id': 'req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:10.841618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cad03252d44f929e09a61b15f18b1d', 'request_id': 'req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:10.859271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] The token cache is being invalidate because project 23cad03252d44f929e09a61b15f18b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:10.860093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:10.861156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ee02e3f8-ad7b-44e3-bfcb-f17faab992dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:10.868135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 898/1789] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:10 2022] DELETE /identity/v3/projects/23cad03252d44f929e09a61b15f18b1d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:10.871428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:10.871868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:10.872915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:10.918740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:10.922269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:11.102120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.102668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.102817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.112603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 892/1790] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:11.129398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:11.131608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:11.147149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 899/1791] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:11.148000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:11.162039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efead54-e7cc-4128-998b-16736ae8210a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:11.194478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:11.194956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.195411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.195863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.196760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:11.197222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:11.199435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:11.210250 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:11.212438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:11.215285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 893/1792] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:11.221566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:11.242092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34f01-993f-4b61-bf53-ccb763bdb247 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:11.250368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:11.252996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.253503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.254139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.255071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c18c38-4bf2-485c-aef9-f76e61554fba None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:11.256270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:11.260415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:11.276734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:11.277770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.278991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.293415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] PATH_INFO: `/v3/projects/06c3f9699a4e490288fa77788bd6d44d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.298008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c3f9699a4e490288fa77788bd6d44d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:11.305729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:11.321041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 894/1793] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:11 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:11.323040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:11.465465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:11.492833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c3f9699a4e490288fa77788bd6d44d', 'request_id': 'req-0c21847d-eae1-4eb8-8f61-1efea019f4d8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:11.508194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8928-6d85-4d79-93a4-9275290f494a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:11.509039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c3f9699a4e490288fa77788bd6d44d', 'request_id': 'req-0c21847d-eae1-4eb8-8f61-1efea019f4d8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:11.533355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c3f9699a4e490288fa77788bd6d44d', 'request_id': 'req-0c21847d-eae1-4eb8-8f61-1efea019f4d8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:11.587872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] The token cache is being invalidate because project 06c3f9699a4e490288fa77788bd6d44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:11.589586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:11.591248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:11.596758 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 900/1794] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:11 2022] DELETE /identity/v3/projects/06c3f9699a4e490288fa77788bd6d44d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:11.597670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:11.603872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:11.683097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609b38-3b69-4144-9f07-c8e7d0fe27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:11.683789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609b38-3b69-4144-9f07-c8e7d0fe27ac admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.684085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609b38-3b69-4144-9f07-c8e7d0fe27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.684427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609b38-3b69-4144-9f07-c8e7d0fe27ac admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.698030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609b38-3b69-4144-9f07-c8e7d0fe27ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:11.714209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609b38-3b69-4144-9f07-c8e7d0fe27ac admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:11.821113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 895/1795] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:11 2022] POST /identity/v3/users => generated 289 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:11.822437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.822727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.823007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.917705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:11.926239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:11.938743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21847d-eae1-4eb8-8f61-1efea019f4d8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:11.961280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 896/1796] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:11.967367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:11.970854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:11.971536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:11.971813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:11.972166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:11.976157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:11.986760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:12.017806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e9a8-f17a-4637-99ff-e8253bf89417 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.022045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.023918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3f7c2-f0f8-4582-b0c7-92b1979b6f82 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.028398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.029193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.030087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.030599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.032568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.035341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.050094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 901/1797] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:12.050794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 897/1798] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:12.053997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.057946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.058516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.058808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.077738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580562-d866-434f-9ed4-6799557bd867 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.084580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.084580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.084580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.085280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.086035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.087854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.109299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 898/1799] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:12.110411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.119472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:12.121897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:12.124170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6514-1650-4c9d-a942-404447d6cc9a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.129398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d4104-6d13-41da-9d15-6432f04a5721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.130238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4104-6d13-41da-9d15-6432f04a5721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.130697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4104-6d13-41da-9d15-6432f04a5721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.131271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4104-6d13-41da-9d15-6432f04a5721 admin admin] PATH_INFO: `/v3/projects/5ffecb0f132a4101a914a2351e1fb60e/users/cdf6b08d94d84d8cbdf24742f716d68f/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.133751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 902/1800] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:12.137957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.150267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a30e0-e922-42cf-b1ec-31f3c8dc69f6 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.155179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d4104-6d13-41da-9d15-6432f04a5721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffecb0f132a4101a914a2351e1fb60e, user_id=cdf6b08d94d84d8cbdf24742f716d68f, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.160085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d4104-6d13-41da-9d15-6432f04a5721 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.164313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.164945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.165221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.165497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.166146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:12.166446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.168437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.188620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 903/1801] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:12.189774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.196017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:12.202236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3983c6-5a01-488e-92a2-351827445451 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.212342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 899/1802] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:12 2022] PUT /identity/v3/projects/5ffecb0f132a4101a914a2351e1fb60e/users/cdf6b08d94d84d8cbdf24742f716d68f/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:12.222713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.223007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.223359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.286880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] MFA Rules not processed for user `cdf6b08d94d84d8cbdf24742f716d68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:12.289640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:12.300289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.301374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.301834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.302112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.302788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.307451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.348807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 904/1803] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:12.352816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.409691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 900/1804] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:12.415616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.449087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2f3e-3fdd-4e3f-81c4-8965d66016c3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.477737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c626e6-6129-4274-8d5d-d58874a4ca65 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.487523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.488469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.489054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.489662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.492099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.494995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:12.495136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.544334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 905/1805] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:12.548541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.565294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5d355-eae4-4ecd-b8d2-36ae8d6c6f34 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.574252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.574947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.575284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.575569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.576429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.576922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.577654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.578060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.578213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.578693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.579320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.583023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.612236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 906/1806] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:12.617356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.631315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780ff47-7faa-4128-908b-33e225fea726 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.633475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 901/1807] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:12.637653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.783372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7e4a-40cf-4956-af20-ba7bcbe107a7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.789374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467394d1-f566-4d8d-bfa2-2b1084ee5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.790004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467394d1-f566-4d8d-bfa2-2b1084ee5870 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.790283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467394d1-f566-4d8d-bfa2-2b1084ee5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.790551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467394d1-f566-4d8d-bfa2-2b1084ee5870 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.791467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467394d1-f566-4d8d-bfa2-2b1084ee5870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.794222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467394d1-f566-4d8d-bfa2-2b1084ee5870 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.799527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cb96b-16ce-42e6-9bfa-039be0000691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.804883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb96b-16ce-42e6-9bfa-039be0000691 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.805206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb96b-16ce-42e6-9bfa-039be0000691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.805789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb96b-16ce-42e6-9bfa-039be0000691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.806172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cb96b-16ce-42e6-9bfa-039be0000691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.808847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cb96b-16ce-42e6-9bfa-039be0000691 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.823415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 902/1808] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:12.823415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe858b-4317-404e-ad42-0f1938160f0e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.823415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe858b-4317-404e-ad42-0f1938160f0e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.823415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe858b-4317-404e-ad42-0f1938160f0e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.825256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 903/1809] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:27:12.826232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe858b-4317-404e-ad42-0f1938160f0e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.843448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe858b-4317-404e-ad42-0f1938160f0e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.852170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 907/1810] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:12.853763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8dc0d-57b6-4a7d-b1fe-6e14503666c3 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.854141 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8dc0d-57b6-4a7d-b1fe-6e14503666c3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.854543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8dc0d-57b6-4a7d-b1fe-6e14503666c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.857177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.858946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.858946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.860855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:12.862265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:12.867797 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:12.876058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:12.893296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 904/1811] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:12.894760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:12.900590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7ca8dc0d-57b6-4a7d-b1fe-6e14503666c3 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:12.902922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7ca8dc0d-57b6-4a7d-b1fe-6e14503666c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:12.950031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a21a6-678b-413c-a26a-b85ad52c7df3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:12.966300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:12.967161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:12.967580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:12.967981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] PATH_INFO: `/v3/projects/e54e3f0ce2ca46f18f74a3a23dbd72ef/users/754fbfc96f1c422699ced60d183c8deb/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.008885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54e3f0ce2ca46f18f74a3a23dbd72ef, user_id=754fbfc96f1c422699ced60d183c8deb, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.013166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.045159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 905/1812] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:12 2022] PUT /identity/v3/projects/e54e3f0ce2ca46f18f74a3a23dbd72ef/users/754fbfc96f1c422699ced60d183c8deb/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:13.046272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.095132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 908/1813] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:27:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:13.096738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.097182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.097647 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.131332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed253a-026e-4e9c-bff3-c644c1cccda5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.140790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.141710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.141994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.142291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] PATH_INFO: `/v3/projects/775b2682d04b43cd953c4a95302d87ad/users/48d4c1546a7f412fbdcd54216bbca80a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.147143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:13.162760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] MFA Rules not processed for user `754fbfc96f1c422699ced60d183c8deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:13.164148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:13.168583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775b2682d04b43cd953c4a95302d87ad, user_id=48d4c1546a7f412fbdcd54216bbca80a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.171885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.190920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 906/1814] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:13 2022] PUT /identity/v3/projects/775b2682d04b43cd953c4a95302d87ad/users/48d4c1546a7f412fbdcd54216bbca80a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:13.193173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.195777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:13.267591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 909/1815] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:13.272839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.283461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c33a-cf2f-4eba-899a-6c077efd4d6f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.287861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f9ae-7310-4fa6-87d9-bb0128f89c47 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.293452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.294063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.294344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.294620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.303876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.305512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.316470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 907/1816] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:13.317253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.346947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.347695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.348099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.349297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.350246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.352196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.364826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 910/1817] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:13.369701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.383643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda2d-9a1e-4818-a088-67836b1e726e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.389226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f900a-e45b-4f04-814a-ec5a577ea509 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.391784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd2e6b-3ce9-434f-a7f5-154a92cb9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.392510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2e6b-3ce9-434f-a7f5-154a92cb9f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.392791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2e6b-3ce9-434f-a7f5-154a92cb9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.393070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2e6b-3ce9-434f-a7f5-154a92cb9f13 admin admin] PATH_INFO: `/v3/projects/775b2682d04b43cd953c4a95302d87ad/users/48d4c1546a7f412fbdcd54216bbca80a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.394443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.395063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.395180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd2e6b-3ce9-434f-a7f5-154a92cb9f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775b2682d04b43cd953c4a95302d87ad, user_id=48d4c1546a7f412fbdcd54216bbca80a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.395340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.395611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.396226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.397844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd2e6b-3ce9-434f-a7f5-154a92cb9f13 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.398154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.410163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 911/1818] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:13 2022] PUT /identity/v3/projects/775b2682d04b43cd953c4a95302d87ad/users/48d4c1546a7f412fbdcd54216bbca80a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:13.421648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.421934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.422441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.432443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 908/1819] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:13 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:13.435993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.437383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:13.454090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] MFA Rules not processed for user `48d4c1546a7f412fbdcd54216bbca80a`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:13.456385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:13.515246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:13.536129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbdeca-d053-4699-9fc0-b7b61b80763e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.548926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.549898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.550331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.550672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.551448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.553880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.567154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 912/1820] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:13.579076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.579777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 909/1821] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:13 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:13.580727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:13.583744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.594405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4918-825b-410f-8e68-6fe0cc588886 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.599320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.600064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.600545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.600826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.601472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.603094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.618849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 910/1822] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:13.619878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.632420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f73a5-f48c-43fc-9f42-d71429baaa21 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.638877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.639559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.639841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.640564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] PATH_INFO: `/v3/projects/820d759f5c3f4392aec1133109882e84/users/7765cb5710d849a89ea11e0ac5e02ce7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.658686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be916c5c-ebe1-4864-88b2-314589e8cf06 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.661128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820d759f5c3f4392aec1133109882e84, user_id=7765cb5710d849a89ea11e0ac5e02ce7, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.663065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.663898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.664107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.664460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.665008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.683683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 911/1823] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:13 2022] PUT /identity/v3/projects/820d759f5c3f4392aec1133109882e84/users/7765cb5710d849a89ea11e0ac5e02ce7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:13.687698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.725297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.727041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.738207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 913/1824] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:13.762404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c594-c339-4f3d-b9d5-b62a16d84cd0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.767157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710106ab-11bd-4598-819f-68e2c2c54768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.767773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710106ab-11bd-4598-819f-68e2c2c54768 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.768157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710106ab-11bd-4598-819f-68e2c2c54768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.768485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710106ab-11bd-4598-819f-68e2c2c54768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.769132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710106ab-11bd-4598-819f-68e2c2c54768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.770765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710106ab-11bd-4598-819f-68e2c2c54768 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.782570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 912/1825] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:13.786756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.802217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19423e7c-f438-4143-9676-ae8eceb7d180 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:13.808625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:13.809302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.809581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.809888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] PATH_INFO: `/v3/projects/820d759f5c3f4392aec1133109882e84/users/7765cb5710d849a89ea11e0ac5e02ce7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.812723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=820d759f5c3f4392aec1133109882e84, user_id=7765cb5710d849a89ea11e0ac5e02ce7, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:13.815537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:13.829486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 914/1826] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:13 2022] PUT /identity/v3/projects/820d759f5c3f4392aec1133109882e84/users/7765cb5710d849a89ea11e0ac5e02ce7/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:13.840389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:13.840684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:13.841131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:13.875599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] MFA Rules not processed for user `7765cb5710d849a89ea11e0ac5e02ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:13.877533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:13.956924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 913/1827] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:13.968266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:13.969977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:14.068338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:14.119490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb37c7-ffe3-4cc4-9523-d6fb7e6656aa admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:14.126758 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22994d-eb66-4d1d-923f-6f86a6d2fc2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:14.129147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22994d-eb66-4d1d-923f-6f86a6d2fc2a service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:14.129570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22994d-eb66-4d1d-923f-6f86a6d2fc2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:14.129948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22994d-eb66-4d1d-923f-6f86a6d2fc2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:14.141166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22994d-eb66-4d1d-923f-6f86a6d2fc2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:14.143109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22994d-eb66-4d1d-923f-6f86a6d2fc2a service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:14.163340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 915/1828] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:14.393008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:14.434509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:14.499959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4155b-279f-4f94-b1af-813cc0e98149 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:14.506676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:14.507439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:14.507726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:14.508118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] PATH_INFO: `/v3/users/754fbfc96f1c422699ced60d183c8deb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:14.509251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=754fbfc96f1c422699ced60d183c8deb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:14.511207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:14.567700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754fbfc96f1c422699ced60d183c8deb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:14.575529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754fbfc96f1c422699ced60d183c8deb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:14.576208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754fbfc96f1c422699ced60d183c8deb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:14.576843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754fbfc96f1c422699ced60d183c8deb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:14.584359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754fbfc96f1c422699ced60d183c8deb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:14.607047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 914/1829] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:14 2022] DELETE /identity/v3/users/754fbfc96f1c422699ced60d183c8deb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:14.613720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:14.613720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:14.613720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:14.632866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:14.634221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:14.699085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 916/1830] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:14.708884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:14.710342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:14.782227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626966c9-2567-425d-a115-1d6995efec2b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:14.786491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788a530-131f-41cd-86d1-923dc54dbcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:14.788056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788a530-131f-41cd-86d1-923dc54dbcdf service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:14.788700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788a530-131f-41cd-86d1-923dc54dbcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:14.789134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788a530-131f-41cd-86d1-923dc54dbcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:14.799656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788a530-131f-41cd-86d1-923dc54dbcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:14.801154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788a530-131f-41cd-86d1-923dc54dbcdf service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:14.813602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 915/1831] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:14.996507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:14.998457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.011195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb75d0-3c26-479c-804d-dfa50d2c1489 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:15.015770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:15.016442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:15.016726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:15.017002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] PATH_INFO: `/v3/users/2548c743d25d4e75af241beeae1bacfb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:15.018161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2548c743d25d4e75af241beeae1bacfb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:15.020098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:15.069954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2548c743d25d4e75af241beeae1bacfb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.082615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2548c743d25d4e75af241beeae1bacfb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.090654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2548c743d25d4e75af241beeae1bacfb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.091725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2548c743d25d4e75af241beeae1bacfb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.102469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2548c743d25d4e75af241beeae1bacfb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.108737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 917/1832] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:14 2022] DELETE /identity/v3/users/2548c743d25d4e75af241beeae1bacfb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:15.113108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:15.113393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:15.113665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:15.133597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:15.134640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.191014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:15.201702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:15.203912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.213489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 916/1833] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:15.214750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:15.216048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.220908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de653cb-b2a2-4456-b5b3-ed67220ea7c0 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:15.226727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:15.227373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:15.227651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:15.227915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] PATH_INFO: `/v3/projects/e54e3f0ce2ca46f18f74a3a23dbd72ef` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:15.229301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54e3f0ce2ca46f18f74a3a23dbd72ef)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:15.231519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:15.282056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0691ab-1333-45dd-a32f-b3c5e259e2d0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:15.294653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:15.299298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54e3f0ce2ca46f18f74a3a23dbd72ef', 'request_id': 'req-f70cede9-a3fd-4952-96af-273958b44598'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.310815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54e3f0ce2ca46f18f74a3a23dbd72ef', 'request_id': 'req-f70cede9-a3fd-4952-96af-273958b44598'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.318773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54e3f0ce2ca46f18f74a3a23dbd72ef', 'request_id': 'req-f70cede9-a3fd-4952-96af-273958b44598'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.331182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] The token cache is being invalidate because project e54e3f0ce2ca46f18f74a3a23dbd72ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:15.331472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.332333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.334478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 918/1834] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:15 2022] DELETE /identity/v3/projects/e54e3f0ce2ca46f18f74a3a23dbd72ef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:15.337909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:15.339439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.347918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:15.348716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:15.348851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:15.349138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:15.354354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.428565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cede9-a3fd-4952-96af-273958b44598 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:15.429413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:15.431046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:15.435809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:15.436848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:15.436848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:15.437013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:15.438828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.447948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 917/1835] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:15.448840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:15.450139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:15.554652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:15.562614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33e60-65ff-4b91-841e-c34cb784c7dd service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:15.570042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:15.571049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:15.571552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:15.572153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] PATH_INFO: `/v3/users/7765cb5710d849a89ea11e0ac5e02ce7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:15.574925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7765cb5710d849a89ea11e0ac5e02ce7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:15.577392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:15.596679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:15.602336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:15.635198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 919/1836] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:15.693977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7765cb5710d849a89ea11e0ac5e02ce7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.715087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7765cb5710d849a89ea11e0ac5e02ce7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.716410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7765cb5710d849a89ea11e0ac5e02ce7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.717909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7765cb5710d849a89ea11e0ac5e02ce7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.741266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7765cb5710d849a89ea11e0ac5e02ce7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:15.776817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 918/1837] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:15 2022] DELETE /identity/v3/users/7765cb5710d849a89ea11e0ac5e02ce7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:16.025731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.027212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.040176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01749f5-c08f-4c5e-ae73-f7d7dcb2e547 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.117328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.117954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.118229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.118500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] PATH_INFO: `/v3/projects/f35ce13bb53b4357a87042445f7c31d8` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.119612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35ce13bb53b4357a87042445f7c31d8)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.121659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.148699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:16.154979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.157235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.175759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35ce13bb53b4357a87042445f7c31d8', 'request_id': 'req-9b6687f9-9412-4524-b9ba-a532634728ca'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.184237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35ce13bb53b4357a87042445f7c31d8', 'request_id': 'req-9b6687f9-9412-4524-b9ba-a532634728ca'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.184704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8be5-0b74-4dc2-93f1-42fa140887ba admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.191583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35ce13bb53b4357a87042445f7c31d8', 'request_id': 'req-9b6687f9-9412-4524-b9ba-a532634728ca'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.209726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] The token cache is being invalidate because project f35ce13bb53b4357a87042445f7c31d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:16.210823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.210823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.215669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 920/1838] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:16 2022] DELETE /identity/v3/projects/f35ce13bb53b4357a87042445f7c31d8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:16.216635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.218066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.254316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.254961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.255238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.255507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] PATH_INFO: `/v3/projects/820d759f5c3f4392aec1133109882e84` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.257705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820d759f5c3f4392aec1133109882e84)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.259616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.314671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6687f9-9412-4524-b9ba-a532634728ca admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.334240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820d759f5c3f4392aec1133109882e84', 'request_id': 'req-a914f88c-a56e-4a25-8af7-f04a4f700459'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.340986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820d759f5c3f4392aec1133109882e84', 'request_id': 'req-a914f88c-a56e-4a25-8af7-f04a4f700459'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.347521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820d759f5c3f4392aec1133109882e84', 'request_id': 'req-a914f88c-a56e-4a25-8af7-f04a4f700459'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.364334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] The token cache is being invalidate because project 820d759f5c3f4392aec1133109882e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:16.365205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.367248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a914f88c-a56e-4a25-8af7-f04a4f700459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.369281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 919/1839] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:16 2022] DELETE /identity/v3/projects/820d759f5c3f4392aec1133109882e84 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:16.375193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5e38-1cbe-46fc-84bd-5cac8efb5f9c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.376298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5e38-1cbe-46fc-84bd-5cac8efb5f9c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.376825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5e38-1cbe-46fc-84bd-5cac8efb5f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.388384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.389045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.389367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.389676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] PATH_INFO: `/v3/users/cd42a0503e054e5c872b78968b2ee3e4` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.390864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd42a0503e054e5c872b78968b2ee3e4)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.392876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.397469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:16.407598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-be9e5e38-1cbe-46fc-84bd-5cac8efb5f9c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:16.409236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-be9e5e38-1cbe-46fc-84bd-5cac8efb5f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.420278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 920/1840] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:16.429002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.429317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.429594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.450328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:16.451570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.452918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd42a0503e054e5c872b78968b2ee3e4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.461236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 921/1841] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:16.465324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.466995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:16.471692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd42a0503e054e5c872b78968b2ee3e4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.475334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad3f8-693c-4aa5-88e8-e7e6c58e20e5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.480350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.480989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.481266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.481537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.482239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:16.482477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.482956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd42a0503e054e5c872b78968b2ee3e4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.483598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd42a0503e054e5c872b78968b2ee3e4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.484055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.492173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd42a0503e054e5c872b78968b2ee3e4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:16.496740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 922/1842] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:27:16.501106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.501580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 921/1843] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:16 2022] DELETE /identity/v3/users/cd42a0503e054e5c872b78968b2ee3e4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:16.506212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.520793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5c0c-5ea4-451c-a747-ec9d27e25edf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.586547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.587073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.587345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.587624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.588291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.591754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.630691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 923/1844] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:16 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:16.632033 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.642225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb587d-23ce-41d0-9469-dec23e2d9fc4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.716189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.716846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.717292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.717528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.718177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.720273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.765051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 922/1845] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:16 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:16.772183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.809237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.821026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:16.854090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcb2d-5a18-4075-84e2-fdfc2e673108 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.863475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.864312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.864437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e833637-b945-4478-99e9-4a2317adbe3d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.864602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.864934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] PATH_INFO: `/v3/projects/d6814dccc77643d38503b08dfcd6eec1` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.866783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6814dccc77643d38503b08dfcd6eec1)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.871962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.874194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.874587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.874981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.876370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.878969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.896498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 924/1846] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:16.897477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.904208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.916866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478856c-ff57-46f8-a8aa-adef5360c7a1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.922882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:16.923683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:16.924137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:16.924576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:16.925356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:16.927100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:16.949970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 925/1847] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:16.952509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:16.980297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429246-7c09-4b31-8ce2-df0a7fc5da22 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:16.999912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6814dccc77643d38503b08dfcd6eec1', 'request_id': 'req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:17.033245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6814dccc77643d38503b08dfcd6eec1', 'request_id': 'req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:17.046362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6814dccc77643d38503b08dfcd6eec1', 'request_id': 'req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:17.062264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] The token cache is being invalidate because project d6814dccc77643d38503b08dfcd6eec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:17.062680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:17.064825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b09f06a-a9e8-47d8-bdcb-67e003f7deb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:17.067308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 923/1848] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:16 2022] DELETE /identity/v3/projects/d6814dccc77643d38503b08dfcd6eec1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:17.073094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b39c-e913-4b67-a66d-21c039af87a2 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.073674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b39c-e913-4b67-a66d-21c039af87a2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.074100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9b39c-e913-4b67-a66d-21c039af87a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.109168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-24d9b39c-e913-4b67-a66d-21c039af87a2 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:17.127271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-24d9b39c-e913-4b67-a66d-21c039af87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:17.150384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bad68-fcb2-4f05-9016-2b78af17cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.151062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bad68-fcb2-4f05-9016-2b78af17cec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.152056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bad68-fcb2-4f05-9016-2b78af17cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.152463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bad68-fcb2-4f05-9016-2b78af17cec0 admin admin] PATH_INFO: `/v3/projects/1a44e89153a14220829f10eadaee3699/users/e2bd7d408dfc4fafacf1299f78e118ad/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.169222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bad68-fcb2-4f05-9016-2b78af17cec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a44e89153a14220829f10eadaee3699, user_id=e2bd7d408dfc4fafacf1299f78e118ad, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.172070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bad68-fcb2-4f05-9016-2b78af17cec0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.193245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 926/1849] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:16 2022] PUT /identity/v3/projects/1a44e89153a14220829f10eadaee3699/users/e2bd7d408dfc4fafacf1299f78e118ad/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:17.213051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.213368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.213842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.225334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:17.259920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 924/1850] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:17.269232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.269377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.272001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.298190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] MFA Rules not processed for user `e2bd7d408dfc4fafacf1299f78e118ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:17.299582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:17.320485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:17.324814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:17.329995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:17.401261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 927/1851] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:17.409251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 925/1852] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:17.413405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.413573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.415492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:17.422980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a704e84-32f6-4884-af2d-6ca3e2b8fc90 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.428234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.428888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.429171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.429443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.430096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:17.430398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.431996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.445224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 926/1853] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:27:17.449742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.461012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c993-a61e-4300-b08c-3130c55a19f5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.465659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.466356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.466721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.467054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.467616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.469597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.486695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08ba2-a75f-42f2-90dd-ae322a482547 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.491836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.492845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.493105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.493339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.499220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 927/1854] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:17.502966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.503108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.504622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.515812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 928/1855] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:17.572167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca634ed1-a633-4563-a1bc-fd1793d14e41 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.578036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.578678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.578959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.579232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.579863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.582108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.611860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 928/1856] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:17.613280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.625191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4b621-46f2-4c58-a816-c4b53a0dcd2d service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.630741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.631341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.631621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.631887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.632619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.634295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.644933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 929/1857] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:17.649944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.660344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af9e65-97a0-4fa7-a5db-cdbbfb686e2f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.666197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2e503-1266-4e26-86e1-7a5c1555c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.666863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2e503-1266-4e26-86e1-7a5c1555c534 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.667143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2e503-1266-4e26-86e1-7a5c1555c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.667491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2e503-1266-4e26-86e1-7a5c1555c534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.668157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2e503-1266-4e26-86e1-7a5c1555c534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.669853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2e503-1266-4e26-86e1-7a5c1555c534 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.681547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 929/1858] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:17.686060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.696282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7295a8e-7e75-4cbb-ac09-c07eff7e2749 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.701021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.701785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.702140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.702496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] PATH_INFO: `/v3/projects/d3d377ade09a46609dab0ffbedf267ca/users/e2988abbcfdf4030baae23a90ae7bafc/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.717964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d377ade09a46609dab0ffbedf267ca, user_id=e2988abbcfdf4030baae23a90ae7bafc, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.720660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.735067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 930/1859] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:17 2022] PUT /identity/v3/projects/d3d377ade09a46609dab0ffbedf267ca/users/e2988abbcfdf4030baae23a90ae7bafc/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:17.746628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.746960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.747227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.778932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] MFA Rules not processed for user `e2988abbcfdf4030baae23a90ae7bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:17.780232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:17.811503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:17.870005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 930/1860] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:17.871773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.934879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d621bf0-f400-48aa-be76-7dba0a522774 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:17.939406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:17.940001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:17.940297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:17.940567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:17.941177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:17.943138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:17.973376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 931/1861] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:17.978227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:17.989112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f4d4d-dc43-42f2-8945-1669cccd2010 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.044163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.044803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.045089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.045354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.045980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.047942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.068411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 931/1862] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:17 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:18.072453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:18.082624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6cf3-dc7f-4d41-a6ab-d2e79138ff57 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.088107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.088732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.089014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.089288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.089923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.091512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.093561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:18.103967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 932/1863] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:18.108154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:18.117914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8231f12-21b6-4bdc-b2a3-5c8305fededa admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.122510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.123079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.123361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.123665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] PATH_INFO: `/v3/projects/fd0704e242844021ba8dd1e44c327999/users/f8278043038e4fe18c5dfdf22363e085/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.138326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0704e242844021ba8dd1e44c327999, user_id=f8278043038e4fe18c5dfdf22363e085, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.141080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.156856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 932/1864] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:18 2022] PUT /identity/v3/projects/fd0704e242844021ba8dd1e44c327999/users/f8278043038e4fe18c5dfdf22363e085/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:18.160894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:18.172003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87171a-01d2-4eb0-bd03-c07e3a998d36 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.250071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563cc28-27c7-4a6d-878a-de4614a1eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.250699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563cc28-27c7-4a6d-878a-de4614a1eeef admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.250973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563cc28-27c7-4a6d-878a-de4614a1eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.251244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563cc28-27c7-4a6d-878a-de4614a1eeef admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.251882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563cc28-27c7-4a6d-878a-de4614a1eeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.253790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563cc28-27c7-4a6d-878a-de4614a1eeef admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.266185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 933/1865] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:18.270834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:18.286527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492f54d-a694-4e76-9aae-d4cad284f241 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.293978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.294821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.295265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.295690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] PATH_INFO: `/v3/projects/fd0704e242844021ba8dd1e44c327999/users/f8278043038e4fe18c5dfdf22363e085/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.297932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0704e242844021ba8dd1e44c327999, user_id=f8278043038e4fe18c5dfdf22363e085, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.301421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.323238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 933/1866] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:18 2022] PUT /identity/v3/projects/fd0704e242844021ba8dd1e44c327999/users/f8278043038e4fe18c5dfdf22363e085/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:18.336271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.336665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.337048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.421318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] MFA Rules not processed for user `f8278043038e4fe18c5dfdf22363e085`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:18.422699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:18.570599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 934/1867] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:18.588516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:18.590781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:18.700945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac891c-66e0-4a7e-94af-d531023a801d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.704555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.705175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.705868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.705868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.716739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.718573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.730952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 934/1868] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:18.875451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:18.887160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3412e32-1e59-4c19-8818-7cf576e5ec24 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:18.890870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d0847-4ec6-4335-ae4c-6ac80d49a549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:18.891479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d0847-4ec6-4335-ae4c-6ac80d49a549 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:18.891759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d0847-4ec6-4335-ae4c-6ac80d49a549 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:18.892032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d0847-4ec6-4335-ae4c-6ac80d49a549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:18.982018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d0847-4ec6-4335-ae4c-6ac80d49a549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:18.982018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d0847-4ec6-4335-ae4c-6ac80d49a549 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:18.997389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 935/1869] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:19.785192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:19.786629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:19.811326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:19.857109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b3b8-1349-411e-af68-2b1c3b77ec6d service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:19.861693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:19.862355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:19.862634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:19.862908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] PATH_INFO: `/v3/users/cdf6b08d94d84d8cbdf24742f716d68f` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:19.864028 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf6b08d94d84d8cbdf24742f716d68f)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:19.866714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:19.923680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf6b08d94d84d8cbdf24742f716d68f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:19.945851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf6b08d94d84d8cbdf24742f716d68f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:19.954041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf6b08d94d84d8cbdf24742f716d68f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:19.954821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf6b08d94d84d8cbdf24742f716d68f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:19.971072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf6b08d94d84d8cbdf24742f716d68f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:19.982369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 935/1870] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:19 2022] DELETE /identity/v3/users/cdf6b08d94d84d8cbdf24742f716d68f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:19.985864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:19.986349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:19.986558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:20.010494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:20.011803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:20.027905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:20.082935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 936/1871] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:20.093171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:20.094608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:20.156714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe08ef7-52e7-421d-bbfd-5e92a72dbef1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:20.160379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:20.160994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:20.161271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:20.161543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:20.171536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:20.172944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:20.183695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 936/1872] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:20.586561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:20.588005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:20.608524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79d9b-2575-4edb-9199-72c5f4805e45 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:20.622029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:20.623259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:20.624001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:20.625946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] PATH_INFO: `/v3/projects/5ffecb0f132a4101a914a2351e1fb60e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:20.629349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffecb0f132a4101a914a2351e1fb60e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:20.632466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:20.732372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffecb0f132a4101a914a2351e1fb60e', 'request_id': 'req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:20.751230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffecb0f132a4101a914a2351e1fb60e', 'request_id': 'req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:20.770517 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffecb0f132a4101a914a2351e1fb60e', 'request_id': 'req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:20.793054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] The token cache is being invalidate because project 5ffecb0f132a4101a914a2351e1fb60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:20.793686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:20.794584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-296cc49b-6d2f-4616-8ea2-f6c1c87fd52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:20.802214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 937/1873] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:20 2022] DELETE /identity/v3/projects/5ffecb0f132a4101a914a2351e1fb60e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:20.802787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:20.827199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f94a-0594-4675-902e-8fde86e38b86 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:20.923241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:20.971172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:20.972019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:20.973645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:20.974084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] PATH_INFO: `/v3/users/48d4c1546a7f412fbdcd54216bbca80a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:20.976739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d4c1546a7f412fbdcd54216bbca80a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:20.986558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:20.994197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c7af-cdb6-4f25-95d2-3b441c3b7924 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:20.994748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c7af-cdb6-4f25-95d2-3b441c3b7924 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:20.994748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c7af-cdb6-4f25-95d2-3b441c3b7924 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:20.996085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 938/1874] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:27:21.019281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.019794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.020473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.070423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:21.070943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:21.086351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d4c1546a7f412fbdcd54216bbca80a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.116953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d4c1546a7f412fbdcd54216bbca80a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.140222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d4c1546a7f412fbdcd54216bbca80a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.143162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d4c1546a7f412fbdcd54216bbca80a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.169267 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d4c1546a7f412fbdcd54216bbca80a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.188399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 937/1875] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:20 2022] DELETE /identity/v3/users/48d4c1546a7f412fbdcd54216bbca80a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:21.220276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 939/1876] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:21.377401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:21.379476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:21.488194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8523a-3290-462d-a993-872d0c584959 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:21.497396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1e1bd-d342-4074-95a4-e30fe81a2986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:21.498037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1e1bd-d342-4074-95a4-e30fe81a2986 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.498846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1e1bd-d342-4074-95a4-e30fe81a2986 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.499264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1e1bd-d342-4074-95a4-e30fe81a2986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.510864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1e1bd-d342-4074-95a4-e30fe81a2986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:21.512550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1e1bd-d342-4074-95a4-e30fe81a2986 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:21.519717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:21.523106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:21.534753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 938/1877] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:21.542591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dbd57-6faf-467c-b8f3-a796274d32fb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:21.584414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:21.622931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:21.623570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.623846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.624119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] PATH_INFO: `/v3/projects/775b2682d04b43cd953c4a95302d87ad` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.625283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=775b2682d04b43cd953c4a95302d87ad)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:21.627302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:21.686126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775b2682d04b43cd953c4a95302d87ad', 'request_id': 'req-be2cfcc3-ccc0-46c7-875f-449f62542f5e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.693157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775b2682d04b43cd953c4a95302d87ad', 'request_id': 'req-be2cfcc3-ccc0-46c7-875f-449f62542f5e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.699072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775b2682d04b43cd953c4a95302d87ad', 'request_id': 'req-be2cfcc3-ccc0-46c7-875f-449f62542f5e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.713375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] The token cache is being invalidate because project 775b2682d04b43cd953c4a95302d87ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:21.713869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.714616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be2cfcc3-ccc0-46c7-875f-449f62542f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:21.716408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 940/1878] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:21 2022] DELETE /identity/v3/projects/775b2682d04b43cd953c4a95302d87ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:21.721321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.721614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.722169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.742646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:21.743896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:21.801996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:21.843083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 939/1879] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:21.844271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.844607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.844917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.867798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:21.869106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:21.881992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 941/1880] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:21.883915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:21.898486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a629b7-34ad-41f2-b0a9-50954465a9fc None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:21.904398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:21.906446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.906731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.907183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.907831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:21.908329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:21.910375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:21.925700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 940/1881] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:21.930137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:21.947898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005028d-9064-47e7-a9b9-4b2ddc2b5f51 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:21.949091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:21.950857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:21.953836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:21.954454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.954736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.955012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.955794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:21.958400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:21.964793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370103-179b-4d8e-9301-8cd816242ba8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:21.970764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:21.971488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:21.971838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:21.972474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] PATH_INFO: `/v3/users/e2988abbcfdf4030baae23a90ae7bafc` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:21.973525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2988abbcfdf4030baae23a90ae7bafc)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:21.977255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.007315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 942/1882] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:21 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:22.009411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.053244 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2988abbcfdf4030baae23a90ae7bafc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:22.070500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2988abbcfdf4030baae23a90ae7bafc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:22.080187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2988abbcfdf4030baae23a90ae7bafc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:22.081183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2988abbcfdf4030baae23a90ae7bafc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:22.093656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-31911b0a-4635-4cbe-849f-c73c80f57621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2988abbcfdf4030baae23a90ae7bafc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:22.103881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 941/1883] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:21 2022] DELETE /identity/v3/users/e2988abbcfdf4030baae23a90ae7bafc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:22.108681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.109090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.109480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.146597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:22.149899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:22.163276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4c1d-2fce-471f-84c3-284545169b30 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.282710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 942/1884] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:22.302526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:22.306777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.309352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:22.340414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:22.341057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.341361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.341612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.342438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:22.344634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.391025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 943/1885] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:22 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:22.391025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.392625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:22.422360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dc28f-a9c8-4e12-885f-efe85de015e0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.427471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:22.430066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:22.430703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.430904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.431181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.431947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:22.434611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.435105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b092c7-cffd-4ab3-a29d-ab29511404bf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.441301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:22.442476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.443849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.444567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.451609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 944/1886] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:22.453617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.455785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:22.457287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.464829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bdd48-5abe-484b-b241-068147d8c279 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.470266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 943/1887] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:22.474977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f712c0-f6b3-41bd-ac32-c86b14b3d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:22.475927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f712c0-f6b3-41bd-ac32-c86b14b3d35f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.476290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f712c0-f6b3-41bd-ac32-c86b14b3d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.476673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f712c0-f6b3-41bd-ac32-c86b14b3d35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.477386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f712c0-f6b3-41bd-ac32-c86b14b3d35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:22.479356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f712c0-f6b3-41bd-ac32-c86b14b3d35f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.492279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 945/1888] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:22.496212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.514235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15309279-6b9e-4ac9-ba78-64a085a686d5 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.528756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:22.529446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.529729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.530000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] PATH_INFO: `/v3/projects/4e8f19a3343d4858b5e40ccfa437e31d/users/ccf4fa4ae4274f6bbb8ab51f5a22b51e/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.555565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8f19a3343d4858b5e40ccfa437e31d, user_id=ccf4fa4ae4274f6bbb8ab51f5a22b51e, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:22.560461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.588277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 944/1889] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:22 2022] PUT /identity/v3/projects/4e8f19a3343d4858b5e40ccfa437e31d/users/ccf4fa4ae4274f6bbb8ab51f5a22b51e/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:22.592518 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.592855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.593136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.625058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] MFA Rules not processed for user `ccf4fa4ae4274f6bbb8ab51f5a22b51e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:22.625851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:22.726950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 946/1890] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:22.731801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.883243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c103a8-80a9-4093-8e04-a995c0f64fdb admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.893964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:22.895276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:22.895568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:22.895893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:22.898383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:22.904877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:22.912078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:22.914142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:22.945131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deeef6-5a60-4445-ab62-153a7ce56ba4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:22.949946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 945/1891] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:22 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:22.950843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.036092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.038269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.038930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.039222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] PATH_INFO: `/v3/projects/d3d377ade09a46609dab0ffbedf267ca` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.040998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d377ade09a46609dab0ffbedf267ca)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.043401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.048675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27fd0a-deca-49d7-82cf-a45f54886084 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.054886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.055510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.055890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.056165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.057142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.060412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.085631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 946/1892] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:22 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:23.089709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.092144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:23.103209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d377ade09a46609dab0ffbedf267ca', 'request_id': 'req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.104029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab6d7c-0718-4f0a-a04f-e08b98d58ad2 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.111132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d377ade09a46609dab0ffbedf267ca', 'request_id': 'req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.117800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d377ade09a46609dab0ffbedf267ca', 'request_id': 'req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.136018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] The token cache is being invalidate because project d3d377ade09a46609dab0ffbedf267ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:23.136438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.137265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.140299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 947/1893] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:22 2022] DELETE /identity/v3/projects/d3d377ade09a46609dab0ffbedf267ca => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:23.143076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.144688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.156927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:23.188142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.188974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.189251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.189525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.190214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.196892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.205728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 947/1894] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:23.206742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.209265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.219376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4e233-2f2a-4990-ad4e-6e3c6f722cab admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.221344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33e433-54a5-4669-9ec3-c28a6be84e07 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.223883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.225230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.225675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.225947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] PATH_INFO: `/v3/users/f8278043038e4fe18c5dfdf22363e085` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.226564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.227071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8278043038e4fe18c5dfdf22363e085)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.227208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.227488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.227761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] PATH_INFO: `/v3/projects/60069d2cc3b3474b8b51073558d1784b/users/7ffee333391e4bf98468fa0ff01b7e5f/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.229031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.243181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60069d2cc3b3474b8b51073558d1784b, user_id=7ffee333391e4bf98468fa0ff01b7e5f, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.245852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.260962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 948/1895] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:23 2022] PUT /identity/v3/projects/60069d2cc3b3474b8b51073558d1784b/users/7ffee333391e4bf98468fa0ff01b7e5f/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:23.264782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.277361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8278043038e4fe18c5dfdf22363e085'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.285056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8278043038e4fe18c5dfdf22363e085'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.285823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8278043038e4fe18c5dfdf22363e085'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.286556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8278043038e4fe18c5dfdf22363e085'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.293597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8278043038e4fe18c5dfdf22363e085'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.311909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 948/1896] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:23 2022] DELETE /identity/v3/users/f8278043038e4fe18c5dfdf22363e085 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:23.328475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ccac4-61f6-4584-9dea-0298b8243061 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.397307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.397914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.398195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.398519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.399120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.401013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.413553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 949/1897] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:23.417740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.420006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.423739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.425516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.436156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52bb96-67aa-4870-85c6-abaafc5034b8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.439222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ea177-a39c-4826-88fb-0016175b980d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.441453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1a1e-437c-498b-be9c-b650e9812b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.442143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1a1e-437c-498b-be9c-b650e9812b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.442496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1a1e-437c-498b-be9c-b650e9812b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.442832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1a1e-437c-498b-be9c-b650e9812b6d admin admin] PATH_INFO: `/v3/projects/60069d2cc3b3474b8b51073558d1784b/users/7ffee333391e4bf98468fa0ff01b7e5f/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.445669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.445824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1a1e-437c-498b-be9c-b650e9812b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60069d2cc3b3474b8b51073558d1784b, user_id=7ffee333391e4bf98468fa0ff01b7e5f, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.446627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.446627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.446828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] PATH_INFO: `/v3/users/e2bd7d408dfc4fafacf1299f78e118ad` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.447968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bd7d408dfc4fafacf1299f78e118ad)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.448636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1a1e-437c-498b-be9c-b650e9812b6d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.450220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.463259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 949/1898] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:23 2022] PUT /identity/v3/projects/60069d2cc3b3474b8b51073558d1784b/users/7ffee333391e4bf98468fa0ff01b7e5f/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:23.478918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.478918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.478918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.520220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] MFA Rules not processed for user `7ffee333391e4bf98468fa0ff01b7e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:23.522677 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bd7d408dfc4fafacf1299f78e118ad'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.527128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:23.533243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.545795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bd7d408dfc4fafacf1299f78e118ad'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.565545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bd7d408dfc4fafacf1299f78e118ad'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.566189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bd7d408dfc4fafacf1299f78e118ad'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.570618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:23.593902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-99d1a4fb-fb47-4e5d-b8a4-824cc0a0cc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bd7d408dfc4fafacf1299f78e118ad'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.601792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 950/1899] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:23 2022] DELETE /identity/v3/users/e2bd7d408dfc4fafacf1299f78e118ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:23.606247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.606878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.608101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.633100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:23.634438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.642511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 950/1900] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:23.657798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.660489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.707123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 951/1901] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:23.719058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.720728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.729449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614c2e-ed73-4149-9c64-93d6e1509fa8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.797231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecaa7a-b155-4a7f-83d8-96e3688ab4fe None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.801419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.802177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.803053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.803329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efe67d-733b-4df9-b938-b6de55fe9da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.803516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.803948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe67d-733b-4df9-b938-b6de55fe9da6 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.804308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe67d-733b-4df9-b938-b6de55fe9da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.804650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe67d-733b-4df9-b938-b6de55fe9da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.814308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.816698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.829736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 952/1902] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:23.842323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:23.844212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:23.860820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ad64-3ef3-4fd5-be44-6c4202f43a3d service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:23.879863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:23.881160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:23.881590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:23.881864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] PATH_INFO: `/v3/projects/fd0704e242844021ba8dd1e44c327999` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:23.883361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0704e242844021ba8dd1e44c327999)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.886073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.919967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe67d-733b-4df9-b938-b6de55fe9da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:23.921563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe67d-733b-4df9-b938-b6de55fe9da6 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:23.953922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0704e242844021ba8dd1e44c327999', 'request_id': 'req-1e4084e0-cb0d-439e-b298-a8ae626e3137'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.963557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0704e242844021ba8dd1e44c327999', 'request_id': 'req-1e4084e0-cb0d-439e-b298-a8ae626e3137'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.966200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 951/1903] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:23.972222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0704e242844021ba8dd1e44c327999', 'request_id': 'req-1e4084e0-cb0d-439e-b298-a8ae626e3137'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.973953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:23.995130 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] The token cache is being invalidate because project fd0704e242844021ba8dd1e44c327999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:23.995722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.997312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1e4084e0-cb0d-439e-b298-a8ae626e3137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:23.999274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 953/1904] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:23 2022] DELETE /identity/v3/projects/fd0704e242844021ba8dd1e44c327999 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:24.004921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.005303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.006247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.048583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:24.049901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.074667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:24.155070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 952/1905] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:24.174828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.175287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.175557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.217242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:24.218518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.243896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.250492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 954/1906] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:24.260372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09b17-be3a-4bd3-adcb-a61444d8539d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.267328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.268208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.268629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.269070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.269831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:24.272129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.272862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.291399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 953/1907] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:24.297466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.303577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.305466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.310080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bd2f-5be1-4aa4-ab33-dd616b3147b7 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.327163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.329637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.329767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b08335-ccd6-4dff-a64b-d9c3fe5921b2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.329951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.330247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.330887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.332884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.337420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.338690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.338981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.339679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] PATH_INFO: `/v3/projects/1a44e89153a14220829f10eadaee3699` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.340878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a44e89153a14220829f10eadaee3699)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.343275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.383678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 955/1908] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:24.385914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.419612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a44e89153a14220829f10eadaee3699', 'request_id': 'req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.432942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a44e89153a14220829f10eadaee3699', 'request_id': 'req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.442348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a44e89153a14220829f10eadaee3699', 'request_id': 'req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.461097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] The token cache is being invalidate because project 1a44e89153a14220829f10eadaee3699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:24.461403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.462596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-755f2e5b-a766-48f1-b2c0-238f4ee6a24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.466787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 954/1909] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:24 2022] DELETE /identity/v3/projects/1a44e89153a14220829f10eadaee3699 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:24.473659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1547fe-b6b5-4b8d-b01f-0b71a48967a5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.474709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1547fe-b6b5-4b8d-b01f-0b71a48967a5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.475464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1547fe-b6b5-4b8d-b01f-0b71a48967a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.502530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c48f-15dc-4dfe-9d95-a3aa0a47df4e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.508837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2f1547fe-b6b5-4b8d-b01f-0b71a48967a5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:24.510453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2f1547fe-b6b5-4b8d-b01f-0b71a48967a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.605169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 955/1910] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:24.614322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.614930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.615382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.643440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.644221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.644673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.644950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.646621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.648227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:24.649112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.650043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.664290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 956/1911] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:24.664927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.670170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.695059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 956/1912] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/users => generated 286 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:24.695059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.703260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c118ff-ec76-4696-b5fb-a0eff61fae7d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.724903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.724903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.724903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.724903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] PATH_INFO: `/v3/users/ccf4fa4ae4274f6bbb8ab51f5a22b51e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.725406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf4fa4ae4274f6bbb8ab51f5a22b51e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.725406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.725530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147b86-dc59-42a3-a8d0-6fc176bcc169 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.734651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.735281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.735563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.735854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.736522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:24.736829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.738458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.756741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 957/1913] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:24.757850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.763558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.778327 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d652e-3dbc-4e27-8b00-904549531a84 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.784802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.785527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.785863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.786151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.786843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.789013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:24.789129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.801534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 958/1914] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:24.803158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.814910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6644d3-8461-4ac3-9d3c-62f46b155182 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:24.816000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf4fa4ae4274f6bbb8ab51f5a22b51e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.821059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:24.821338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:24.821651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:24.821967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:24.822768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:24.825253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:24.827045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf4fa4ae4274f6bbb8ab51f5a22b51e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.828431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf4fa4ae4274f6bbb8ab51f5a22b51e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.829968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf4fa4ae4274f6bbb8ab51f5a22b51e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.839915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf4fa4ae4274f6bbb8ab51f5a22b51e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:24.857773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 959/1915] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:24.862080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.864237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.865233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 957/1916] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:24 2022] DELETE /identity/v3/users/ccf4fa4ae4274f6bbb8ab51f5a22b51e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:24.866190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:24.869153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:24.887701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:24.950531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8975-0b80-423b-8999-689eced1bb7a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.002428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eff486-4852-4751-a0cf-b136df71db05 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.009826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e54eca-ce9c-4f42-a976-a5012399ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.010458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e54eca-ce9c-4f42-a976-a5012399ee00 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.010737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e54eca-ce9c-4f42-a976-a5012399ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.011009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e54eca-ce9c-4f42-a976-a5012399ee00 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.011755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e54eca-ce9c-4f42-a976-a5012399ee00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.016607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e54eca-ce9c-4f42-a976-a5012399ee00 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.066508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 958/1917] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:24 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:25.066508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.066508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.066508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.080795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.081857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.084680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.085147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.087648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.092232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.127449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:25.132053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 960/1918] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:25.132053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.137091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:25.148965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82621-6b31-4028-9122-5e2f9207feff admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.156145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.157546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.157935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.158358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.159173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.160739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 959/1919] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:25.161513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.162471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.178275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7fc5e-6903-42e6-b23e-19a87f0a53bf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.180543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 961/1920] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:25.181517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.186498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.187743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.188224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.188746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] PATH_INFO: `/v3/projects/3fc5ccc68d76456eaa818fd1aa0bbc95/users/53f47a9e7bcd4881b6c164d6be339cd3/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.196155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296e94-cb76-428b-9307-64c017be2ecd admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.206117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.206909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc5ccc68d76456eaa818fd1aa0bbc95, user_id=53f47a9e7bcd4881b6c164d6be339cd3, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.207024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.207411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.207959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.209667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.211143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.211781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.228490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 962/1921] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:25.229421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.232644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:25.243676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 960/1922] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:25 2022] PUT /identity/v3/projects/3fc5ccc68d76456eaa818fd1aa0bbc95/users/53f47a9e7bcd4881b6c164d6be339cd3/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:25.243676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.311598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606b3d-f47f-41c7-a6f9-382311f3b74a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.331017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d9c3d-2a09-4ee2-88d1-92f1bc28c224 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.340416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc766d7-4c36-4558-8e35-c1d16071d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.341115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc766d7-4c36-4558-8e35-c1d16071d899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.341397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc766d7-4c36-4558-8e35-c1d16071d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.341676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc766d7-4c36-4558-8e35-c1d16071d899 admin admin] PATH_INFO: `/v3/projects/b27845ab679f41728f1dbba4feb71e19/users/3ebb1c2adb3b47cd9a843758276f66d1/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.345194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:25.367712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc766d7-4c36-4558-8e35-c1d16071d899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27845ab679f41728f1dbba4feb71e19, user_id=3ebb1c2adb3b47cd9a843758276f66d1, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.373131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc766d7-4c36-4558-8e35-c1d16071d899 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.411349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 961/1923] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:25 2022] PUT /identity/v3/projects/b27845ab679f41728f1dbba4feb71e19/users/3ebb1c2adb3b47cd9a843758276f66d1/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:25.411349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.411349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.411349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.413113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05565e-6f1b-4503-854b-42c3a003e50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.413113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05565e-6f1b-4503-854b-42c3a003e50b service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.413113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05565e-6f1b-4503-854b-42c3a003e50b service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.413339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05565e-6f1b-4503-854b-42c3a003e50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.428468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:25.434376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05565e-6f1b-4503-854b-42c3a003e50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.435862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05565e-6f1b-4503-854b-42c3a003e50b service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.438354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] MFA Rules not processed for user `53f47a9e7bcd4881b6c164d6be339cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:25.439726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:25.451759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 963/1924] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:25.453390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.453810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.454103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.493689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] MFA Rules not processed for user `3ebb1c2adb3b47cd9a843758276f66d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:25.495265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:25.560550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 962/1925] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:25.572934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.574947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:25.588174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 964/1926] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:25.600600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.602292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:25.675784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaff47-adfc-4d36-a5e1-55e071a2b027 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.678062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5606b-a5a6-41e9-b08e-b63f85262c4f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.681255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.681987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.682407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.682686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.685729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299b8e-731b-44d1-afa7-b45a29bcae72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.686743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299b8e-731b-44d1-afa7-b45a29bcae72 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.687171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299b8e-731b-44d1-afa7-b45a29bcae72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.688321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299b8e-731b-44d1-afa7-b45a29bcae72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.693539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.695842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.703863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299b8e-731b-44d1-afa7-b45a29bcae72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.706228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299b8e-731b-44d1-afa7-b45a29bcae72 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.719977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 965/1927] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:25.756989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 963/1928] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:25.764128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:25.882000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca0d8-fcfc-4fc6-a921-6a5ab29b5047 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:25.888438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:25.891753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:25.892276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:25.892765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] PATH_INFO: `/v3/users/53f47a9e7bcd4881b6c164d6be339cd3` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:25.901240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f47a9e7bcd4881b6c164d6be339cd3)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:25.903865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:25.969066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:26.016448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f47a9e7bcd4881b6c164d6be339cd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.046569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f47a9e7bcd4881b6c164d6be339cd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.061597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f47a9e7bcd4881b6c164d6be339cd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.062372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f47a9e7bcd4881b6c164d6be339cd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.076533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f47a9e7bcd4881b6c164d6be339cd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.089858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 966/1929] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:25 2022] DELETE /identity/v3/users/53f47a9e7bcd4881b6c164d6be339cd3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:26.095414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.095877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.096082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.139375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:26.143065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.335671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 964/1930] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:26.358079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:26.360343 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.485579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa6da-ce24-444e-ab6e-d87eaad59b30 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:26.494887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:26.498264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.507876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:26.509321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.509497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.511000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.519523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb15a-74c4-4fbb-8f8e-8dbc4f3ee6ca None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:26.526039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:26.530061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.530422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.530805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] PATH_INFO: `/v3/users/8620a60cc24a49a392166940e2ba7ee8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.533271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8620a60cc24a49a392166940e2ba7ee8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:26.535502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:26.540000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:26.541706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:26.560787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:26.562258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 967/1931] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:26.562995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:26.576143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.593626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4015-fa93-4aa0-9e19-76f216c3f5fb service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:26.603789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:26.604535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.604823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.605248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] PATH_INFO: `/v3/projects/4e8f19a3343d4858b5e40ccfa437e31d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.606447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8f19a3343d4858b5e40ccfa437e31d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:26.608417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:26.642851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8620a60cc24a49a392166940e2ba7ee8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.650204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8620a60cc24a49a392166940e2ba7ee8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.650964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8620a60cc24a49a392166940e2ba7ee8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.652078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8620a60cc24a49a392166940e2ba7ee8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.660537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf826910-adfb-48f4-a054-d6aabeee897f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8620a60cc24a49a392166940e2ba7ee8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.670788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8f19a3343d4858b5e40ccfa437e31d', 'request_id': 'req-960af1e1-0514-4256-b14d-670a118cfddc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.681657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8f19a3343d4858b5e40ccfa437e31d', 'request_id': 'req-960af1e1-0514-4256-b14d-670a118cfddc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.687914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8f19a3343d4858b5e40ccfa437e31d', 'request_id': 'req-960af1e1-0514-4256-b14d-670a118cfddc'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.691757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 965/1932] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:26 2022] DELETE /identity/v3/users/8620a60cc24a49a392166940e2ba7ee8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:26.696514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.696801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.697085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.701987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] The token cache is being invalidate because project 4e8f19a3343d4858b5e40ccfa437e31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:26.702278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.702945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.704940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 968/1933] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:26 2022] DELETE /identity/v3/projects/4e8f19a3343d4858b5e40ccfa437e31d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:26.710076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:26.711464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.720411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:26.721698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.760356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:26.795412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 966/1934] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:26.804678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:26.806920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:26.821175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af1e1-0514-4256-b14d-670a118cfddc admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:26.827466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:26.828137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.828517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.828786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] PATH_INFO: `/v3/users/7ffee333391e4bf98468fa0ff01b7e5f` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.830295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffee333391e4bf98468fa0ff01b7e5f)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:26.832409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:26.891896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8a5f-c184-43b2-98d9-a96a8a3a79c0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:26.909420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffee333391e4bf98468fa0ff01b7e5f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.924505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77af2b-27ea-43b5-b295-8c63ef39e31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:26.926085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffee333391e4bf98468fa0ff01b7e5f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.926850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77af2b-27ea-43b5-b295-8c63ef39e31f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:26.929425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77af2b-27ea-43b5-b295-8c63ef39e31f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:26.929878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77af2b-27ea-43b5-b295-8c63ef39e31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:26.935616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffee333391e4bf98468fa0ff01b7e5f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.936593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffee333391e4bf98468fa0ff01b7e5f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.956235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffee333391e4bf98468fa0ff01b7e5f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:26.968046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77af2b-27ea-43b5-b295-8c63ef39e31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:26.969726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77af2b-27ea-43b5-b295-8c63ef39e31f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:26.975251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 969/1935] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:26 2022] DELETE /identity/v3/users/7ffee333391e4bf98468fa0ff01b7e5f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:26.980320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:26.982825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.010415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 967/1936] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:27.128534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb35c-66d2-4719-b921-28491982c5b3 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:27.135626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:27.136210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.136523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.136801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] PATH_INFO: `/v3/projects/3fc5ccc68d76456eaa818fd1aa0bbc95` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.138522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc5ccc68d76456eaa818fd1aa0bbc95)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:27.140749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:27.228350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc5ccc68d76456eaa818fd1aa0bbc95', 'request_id': 'req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.231388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:27.238062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc5ccc68d76456eaa818fd1aa0bbc95', 'request_id': 'req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.249257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc5ccc68d76456eaa818fd1aa0bbc95', 'request_id': 'req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.267257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] The token cache is being invalidate because project 3fc5ccc68d76456eaa818fd1aa0bbc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:27.267599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.269029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7516f94d-6d2c-4eb8-9cc8-baa2f8099dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.270853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 970/1937] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:26 2022] DELETE /identity/v3/projects/3fc5ccc68d76456eaa818fd1aa0bbc95 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:27.276943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.277416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.277861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.300604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:27.301917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.352712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:27.399246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 968/1938] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:27.408080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.408609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.408726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.430013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:27.431936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.441069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 971/1939] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:27.446063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:27.463274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be952-b9ee-459d-a8c2-dae9e110b308 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:27.466683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:27.467371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.467688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.468359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.468647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:27.469020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:27.470768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:27.486409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:27.488344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.498183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 969/1940] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:27.499212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:27.505500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c613-505b-4565-8723-5eb414542d33 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:27.512981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:27.513888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.514875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.525499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] PATH_INFO: `/v3/projects/60069d2cc3b3474b8b51073558d1784b` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.527530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60069d2cc3b3474b8b51073558d1784b)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:27.528843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33043-3094-4f5d-bf98-ac187195b964 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:27.530428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:27.548694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:27.549347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.550449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.550735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.551379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:27.554599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:27.612177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 970/1941] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:27 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:27.612177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:27.612789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60069d2cc3b3474b8b51073558d1784b', 'request_id': 'req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.615180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.626237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60069d2cc3b3474b8b51073558d1784b', 'request_id': 'req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.637538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60069d2cc3b3474b8b51073558d1784b', 'request_id': 'req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.660663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] The token cache is being invalidate because project 60069d2cc3b3474b8b51073558d1784b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:27.660954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.661705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.664464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 972/1942] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:27 2022] DELETE /identity/v3/projects/60069d2cc3b3474b8b51073558d1784b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:27.665466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:27.666778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.768523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392cd7c-8130-4bcb-8e5a-8f131e271992 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:27.783126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:27.783930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.784365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.784737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] PATH_INFO: `/v3/projects/872e510078aa4c53a5b2c706ee81eea2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.803676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872e510078aa4c53a5b2c706ee81eea2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:27.805804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:27.842702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6b290-025f-444e-9cc9-7ae9fbe1ed5c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:27.858856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3616d4a-0317-4bd6-b66f-1928657cb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:27.859320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616d4a-0317-4bd6-b66f-1928657cb64b admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.859606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616d4a-0317-4bd6-b66f-1928657cb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.859880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3616d4a-0317-4bd6-b66f-1928657cb64b admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.860776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3616d4a-0317-4bd6-b66f-1928657cb64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:27.862736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3616d4a-0317-4bd6-b66f-1928657cb64b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:27.906289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872e510078aa4c53a5b2c706ee81eea2', 'request_id': 'req-b12a7920-5dcf-4711-8af6-1d5d9c30a237'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.912797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 973/1943] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:27 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:27.914224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:27.914519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:27.914798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:27.925685 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872e510078aa4c53a5b2c706ee81eea2', 'request_id': 'req-b12a7920-5dcf-4711-8af6-1d5d9c30a237'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.932761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872e510078aa4c53a5b2c706ee81eea2', 'request_id': 'req-b12a7920-5dcf-4711-8af6-1d5d9c30a237'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.944716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:27.946038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:27.957999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] The token cache is being invalidate because project 872e510078aa4c53a5b2c706ee81eea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:27.959970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.962939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:27.964860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 971/1944] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:27 2022] DELETE /identity/v3/projects/872e510078aa4c53a5b2c706ee81eea2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:27.966803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:27.971067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:28.026166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:28.077627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 974/1945] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:28.079640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.081659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:28.086429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:28.100620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06391dc3-9c37-470c-af9a-a3a34fe06551 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.105660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.106589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.107027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.107303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] PATH_INFO: `/v3/users/444c24f91fb6479c98c394650840ddd6` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.108478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444c24f91fb6479c98c394650840ddd6)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.110458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.163802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a7920-5dcf-4711-8af6-1d5d9c30a237 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.170863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49089678-aef2-4168-835d-0837eb961109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.172639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49089678-aef2-4168-835d-0837eb961109 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.172927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49089678-aef2-4168-835d-0837eb961109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.173954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49089678-aef2-4168-835d-0837eb961109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.174761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49089678-aef2-4168-835d-0837eb961109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.178004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49089678-aef2-4168-835d-0837eb961109 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.182366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444c24f91fb6479c98c394650840ddd6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:28.202248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 972/1946] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:28.204163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.204484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.206126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.220041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444c24f91fb6479c98c394650840ddd6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:28.242338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444c24f91fb6479c98c394650840ddd6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:28.244547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444c24f91fb6479c98c394650840ddd6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:28.247465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:28.249199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:28.257595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444c24f91fb6479c98c394650840ddd6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:28.270736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 973/1947] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:28.271962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.272397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 975/1948] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:28 2022] DELETE /identity/v3/users/444c24f91fb6479c98c394650840ddd6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:28.275048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.283974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:28.315764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aef50-9b52-42cf-a731-bf0a24bb7411 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.469483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.470373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.471266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.471740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.472554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.475866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.508890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05647c2-432e-4ec1-a2a5-dc310bbb5e97 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.518382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 974/1949] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:28.521924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.526290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.526742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.527796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.528084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.531237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:28.531721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.535852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.548279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c34923-cecd-4282-af26-3ccc0486a05b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.555655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd2bb3-11b2-448d-ad22-b380e66d308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.556619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd2bb3-11b2-448d-ad22-b380e66d308c admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.556965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd2bb3-11b2-448d-ad22-b380e66d308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.557328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd2bb3-11b2-448d-ad22-b380e66d308c admin admin] PATH_INFO: `/v3/projects/441c81a99ab84598823bf96d41c22ab8/users/dfa2616b5f8540ed9e3e90c48af042ce/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.577973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 976/1950] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:28.579864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.589527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd2bb3-11b2-448d-ad22-b380e66d308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=441c81a99ab84598823bf96d41c22ab8, user_id=dfa2616b5f8540ed9e3e90c48af042ce, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.596736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd2bb3-11b2-448d-ad22-b380e66d308c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.607708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7e78c-3183-41a4-b054-b710e5fabee6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.626092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.626421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.626535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.626792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.628157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.632764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.633033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 975/1951] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:28 2022] PUT /identity/v3/projects/441c81a99ab84598823bf96d41c22ab8/users/dfa2616b5f8540ed9e3e90c48af042ce/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:28.648934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.649223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.649529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.683660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 977/1952] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:28 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:28.685394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] MFA Rules not processed for user `dfa2616b5f8540ed9e3e90c48af042ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:28.686937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:28.687607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.772137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:28.783481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 976/1953] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:28.789230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.821380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:28.838571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549816d7-8f2e-4326-85cf-64d3f2aa4dcf admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.844784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.845629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.845920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.846197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.846911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.848997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.875233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85322-374c-4f4e-b404-5a956477a041 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.885145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.886374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.886374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.886839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.887726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.891001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.892103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 978/1954] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:28 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:28.903564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.922493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00adf7a-d83d-4650-b180-6b3e2551a2f9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:28.929412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:28.930238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:28.930781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:28.931233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:28.932041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:28.934415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:28.942343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 977/1955] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:28 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:28.948438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.952686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 979/1956] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:28.953976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:28.967968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450c9f-87d3-4c8e-8b4e-bf7c8c9495d2 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.050419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.051084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.051467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.051744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.053397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.055243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.071050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73520a39-351d-4b45-acb0-b7621b4d2a4d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.076154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.076802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.077076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.077345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.077855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 980/1957] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:29.078077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.078774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.080348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.086801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.109531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 978/1958] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:28 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:29.109531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.110902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e79b71-d640-4b5c-86e2-64b4badd184e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.116065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.116733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.117017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.117291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] PATH_INFO: `/v3/projects/c2fa570c689b4bbeb899adb379714c49` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.118483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fa570c689b4bbeb899adb379714c49)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.121487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.131323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1fead-16c5-448f-8693-ab051299dda8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.138314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.139023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.139282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.139714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] PATH_INFO: `/v3/projects/627323b87c484cec9f3e3747e537f17b/users/fdb85c9ae1bc477994e22212bc262958/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.157146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627323b87c484cec9f3e3747e537f17b, user_id=fdb85c9ae1bc477994e22212bc262958, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.160025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.175916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 979/1959] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:29 2022] PUT /identity/v3/projects/627323b87c484cec9f3e3747e537f17b/users/fdb85c9ae1bc477994e22212bc262958/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:29.176985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.189079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fa570c689b4bbeb899adb379714c49', 'request_id': 'req-9d6a3250-27c2-4ce1-81c7-66408e48183d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.203009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fa570c689b4bbeb899adb379714c49', 'request_id': 'req-9d6a3250-27c2-4ce1-81c7-66408e48183d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.209436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fa570c689b4bbeb899adb379714c49', 'request_id': 'req-9d6a3250-27c2-4ce1-81c7-66408e48183d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.220806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] The token cache is being invalidate because project c2fa570c689b4bbeb899adb379714c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:29.221096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.221810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9d6a3250-27c2-4ce1-81c7-66408e48183d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.223317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 981/1960] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:29 2022] DELETE /identity/v3/projects/c2fa570c689b4bbeb899adb379714c49 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:29.224907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7de4-6cf1-46ee-8ba4-8e576abcbb2a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.225199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7de4-6cf1-46ee-8ba4-8e576abcbb2a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.225468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7de4-6cf1-46ee-8ba4-8e576abcbb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.251155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317538-bf5a-4388-be1a-21302e258ef1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.253205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-787a7de4-6cf1-46ee-8ba4-8e576abcbb2a None None] MFA Rules not processed for user `fdb85c9ae1bc477994e22212bc262958`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:29.254412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-787a7de4-6cf1-46ee-8ba4-8e576abcbb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.256564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e644e0e-c3d5-4d28-88d8-52bc7ba2188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.257298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644e0e-c3d5-4d28-88d8-52bc7ba2188f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.257581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644e0e-c3d5-4d28-88d8-52bc7ba2188f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.257851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644e0e-c3d5-4d28-88d8-52bc7ba2188f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.258492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e644e0e-c3d5-4d28-88d8-52bc7ba2188f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.260793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e644e0e-c3d5-4d28-88d8-52bc7ba2188f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.271234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 980/1961] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:29.272343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.272631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.272908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.275186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:29.287751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:29.294286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:29.295500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.303949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 981/1962] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:29.304782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.306003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.317294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a777f-f7d0-4574-9b7b-ab0d818f3549 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.323006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.323658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.323936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.324212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] PATH_INFO: `/v3/projects/78f54cc7a63c4ffd902fecef31e80578/users/8ff12f446d4b46fd8a32add079584701/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.331644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 982/1963] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:29.334468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.334765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.335089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.340458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f54cc7a63c4ffd902fecef31e80578, user_id=8ff12f446d4b46fd8a32add079584701, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.343182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.354660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:29.355884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.357267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 982/1964] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:29 2022] PUT /identity/v3/projects/78f54cc7a63c4ffd902fecef31e80578/users/8ff12f446d4b46fd8a32add079584701/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:29.358055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.359654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.433024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 983/1965] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:29.437387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.440151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6374-3974-41d2-8355-8804fe44cac5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.447733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec5ab-6c1f-4635-a93b-3cb7f15da933 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.448058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.448857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.449204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.449887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.450618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.452983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.453084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.453613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.453891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.454159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.454802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.456414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.468193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 984/1966] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:29.469212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.482494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47462d-b6e7-4718-8ecf-37e908d7dae0 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.487395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.488043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.488443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.488726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.489374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:29.490218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.491248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 983/1967] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:29.492287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.492404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.509931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 985/1968] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:29.510822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.520903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97877c2-6b22-4370-9f46-6a0e4b62c882 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.573990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cd3e8-4ed3-4b24-afd6-ecaeea299ce9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.579505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.580168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.580783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.581129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] PATH_INFO: `/v3/projects/78f54cc7a63c4ffd902fecef31e80578/users/8ff12f446d4b46fd8a32add079584701/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.582967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f54cc7a63c4ffd902fecef31e80578, user_id=8ff12f446d4b46fd8a32add079584701, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.585074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2f708-72cf-4577-a3b1-326843e1c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.585775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f708-72cf-4577-a3b1-326843e1c670 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.586128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f708-72cf-4577-a3b1-326843e1c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.586280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.586540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f708-72cf-4577-a3b1-326843e1c670 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.587273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f708-72cf-4577-a3b1-326843e1c670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.589539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f708-72cf-4577-a3b1-326843e1c670 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.606035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 984/1969] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:29 2022] PUT /identity/v3/projects/78f54cc7a63c4ffd902fecef31e80578/users/8ff12f446d4b46fd8a32add079584701/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:29.606937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.623173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 986/1970] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:29.623173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.623173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.623173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.650693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] MFA Rules not processed for user `8ff12f446d4b46fd8a32add079584701`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:29.651860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.665937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:29.673624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:29.684021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df560-453d-4e7e-9a47-04b902a28178 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.689909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.690828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.690828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.691113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.691736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.694358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.721446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 985/1971] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/projects => generated 407 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:29.722277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.731234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 987/1972] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:29.732082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.733402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.748532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26583ce-929d-44ad-8ef3-b87c455fcab3 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.789429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315d497-8407-47c9-8247-e0cd0b1c38dc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.794931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.795632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.796135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.796287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.796869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.798482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.805155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.805798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.806078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.806352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] PATH_INFO: `/v3/users/3ebb1c2adb3b47cd9a843758276f66d1` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.807483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebb1c2adb3b47cd9a843758276f66d1)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.812165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 986/1973] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:29.812318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.812399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.820814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f916c-68a0-4bce-b963-ecc7cb870721 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.825728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:29.826330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:29.826613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:29.826885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:29.827511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:29.829475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:29.853670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 987/1974] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:29 2022] POST /identity/v3/users => generated 304 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:29.854403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.856131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.864076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebb1c2adb3b47cd9a843758276f66d1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.877365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebb1c2adb3b47cd9a843758276f66d1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.886420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebb1c2adb3b47cd9a843758276f66d1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.887137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebb1c2adb3b47cd9a843758276f66d1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.894817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebb1c2adb3b47cd9a843758276f66d1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:29.903598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 988/1975] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:29 2022] DELETE /identity/v3/users/3ebb1c2adb3b47cd9a843758276f66d1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:29.904221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:29.907840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:29.929454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337462bf-72a3-4b09-882e-67652c528707 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:29.959670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:30.008443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.009225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.009679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.010028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.012711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.039372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e637-cfa0-4acc-beae-ce1a058811ff admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.050914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.051703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.053767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.055448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] PATH_INFO: `/v3/projects/2c537af69ef54e73b74cb2ef7e27a395/users/c2d1b254b1d04a59aaf89f9e63f88c46/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.060693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:30.074829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c537af69ef54e73b74cb2ef7e27a395, user_id=c2d1b254b1d04a59aaf89f9e63f88c46, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.077933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.093908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 989/1976] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:29 2022] PUT /identity/v3/projects/2c537af69ef54e73b74cb2ef7e27a395/users/c2d1b254b1d04a59aaf89f9e63f88c46/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:30.094801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.098092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.102624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.104097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f303-ef51-48e4-b1ff-b009bab1db32 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.113315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 988/1977] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:30.116659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.116945 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.117226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.137900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:30.139116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.180021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18eee-ce89-4a22-812c-99756b50129e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.185566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.187339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.187694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.188040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.188844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.190473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.201082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 990/1978] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:30.204715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.214607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 989/1979] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:30.216053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38ace-a6c6-4d75-8d32-d9144407f0d3 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.218578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.221066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.221686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.221968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.222251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.222902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.225368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.229693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624e248-bc64-48ab-a51f-3f3ab07e9e91 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.234575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.235188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.235467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.235743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.236422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.238133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.243511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 991/1980] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:30.245201 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.253025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 990/1981] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:30.253289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.253393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.261508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9b4d-f3be-49ee-a7f1-67e2fd8822d4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.270028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.271134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.271597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.272638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] PATH_INFO: `/v3/projects/2c537af69ef54e73b74cb2ef7e27a395/users/c2d1b254b1d04a59aaf89f9e63f88c46/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.275375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c537af69ef54e73b74cb2ef7e27a395, user_id=c2d1b254b1d04a59aaf89f9e63f88c46, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.279541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.298079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 991/1982] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:30 2022] PUT /identity/v3/projects/2c537af69ef54e73b74cb2ef7e27a395/users/c2d1b254b1d04a59aaf89f9e63f88c46/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:30.298835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.334209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558509-d26c-4896-9531-13f359e5686c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.405324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b1f1-fa25-4f50-be59-05b7fda98927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.405479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75f56-acb1-4a34-87dd-b3d5061da51d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.405959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b1f1-fa25-4f50-be59-05b7fda98927 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.406357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b1f1-fa25-4f50-be59-05b7fda98927 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.406631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b1f1-fa25-4f50-be59-05b7fda98927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.426157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f3c7-7ced-49b1-b2c6-f1a82d1b15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.426842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f3c7-7ced-49b1-b2c6-f1a82d1b15d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.427806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f3c7-7ced-49b1-b2c6-f1a82d1b15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.428209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f3c7-7ced-49b1-b2c6-f1a82d1b15d5 admin admin] PATH_INFO: `/v3/projects/ec43415483ef44b195339f34641fb438/users/75a83917bf4f4d718386334d0a9147af/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.433459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b1f1-fa25-4f50-be59-05b7fda98927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.436403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358b1f1-fa25-4f50-be59-05b7fda98927 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.442132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:30.453226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f3c7-7ced-49b1-b2c6-f1a82d1b15d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec43415483ef44b195339f34641fb438, user_id=75a83917bf4f4d718386334d0a9147af, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.454180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 992/1983] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:30.455586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.456339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.456717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.456831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f3c7-7ced-49b1-b2c6-f1a82d1b15d5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.482359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 992/1984] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:30 2022] PUT /identity/v3/projects/ec43415483ef44b195339f34641fb438/users/75a83917bf4f4d718386334d0a9147af/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:30.493984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.494419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.494556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.504695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] MFA Rules not processed for user `c2d1b254b1d04a59aaf89f9e63f88c46`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:30.506311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.533834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] MFA Rules not processed for user `75a83917bf4f4d718386334d0a9147af`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:30.535476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.563583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:30.589862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 993/1985] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:30.608618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.610712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.633330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 993/1986] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:30.637857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.693366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffaa71-3296-408b-ba4f-c88c2e8e8164 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.697930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.698279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.698564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.698887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.713635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.715295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.722137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbd63d-5d78-42f2-9533-9db981a6c152 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.727943 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 994/1987] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:30.728101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.728538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.728821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.729097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.729832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.731741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.765366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 994/1988] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:30 2022] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:30.770402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.785806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597162e1-be09-49cc-8e3f-dae872e5ad25 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.841441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.861301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.862652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.863077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.863592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.864348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.867832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.904351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 995/1989] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:30 2022] POST /identity/v3/users => generated 311 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:30.905592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.918921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b75f5b-d310-4dad-858d-815f994f5258 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.925616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.926367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.926824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.927386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.928105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:30.929879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:30.967646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 996/1990] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:30.979857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:30.987663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10367027-9f68-4d0b-a178-c3982fd11f66 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:30.992587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:30.993218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:30.993498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:30.993792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:30.995795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:30.998778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:31.006428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f41d-8dbc-40f2-b231-13b65bd1e5d3 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.028290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.028450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.028707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.031218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] PATH_INFO: `/v3/projects/53d529da2de84f8399e525f1cd05c05e/users/b983f50032274dfbb2cd62ab3d9c5a21/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.055150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d529da2de84f8399e525f1cd05c05e, user_id=b983f50032274dfbb2cd62ab3d9c5a21, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.058868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.087287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 997/1991] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:30 2022] PUT /identity/v3/projects/53d529da2de84f8399e525f1cd05c05e/users/b983f50032274dfbb2cd62ab3d9c5a21/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:31.087287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.090590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:31.094975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.096795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.104891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:31.116978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 995/1992] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:31.118973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.162107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a35f2-dc57-4080-89bf-11e22e064236 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.290045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf70-1eb6-476b-ae05-6c6ee04a1011 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.320221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.323997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.324665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.324948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.325250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.325956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.327504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.332462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.332753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.333027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] PATH_INFO: `/v3/projects/b27845ab679f41728f1dbba4feb71e19` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.335113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27845ab679f41728f1dbba4feb71e19)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.337059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.345247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 996/1993] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:31.346154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.359327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a572f-b188-4c27-8e43-9858462fee5c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.366127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7302d-2488-48af-8ddd-3347b12fbc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.366879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7302d-2488-48af-8ddd-3347b12fbc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.367227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7302d-2488-48af-8ddd-3347b12fbc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.367589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7302d-2488-48af-8ddd-3347b12fbc77 admin admin] PATH_INFO: `/v3/projects/53d529da2de84f8399e525f1cd05c05e/users/b983f50032274dfbb2cd62ab3d9c5a21/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.370550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7302d-2488-48af-8ddd-3347b12fbc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d529da2de84f8399e525f1cd05c05e, user_id=b983f50032274dfbb2cd62ab3d9c5a21, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.374932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7302d-2488-48af-8ddd-3347b12fbc77 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.391202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 997/1994] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:31 2022] PUT /identity/v3/projects/53d529da2de84f8399e525f1cd05c05e/users/b983f50032274dfbb2cd62ab3d9c5a21/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:31.403366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.403657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.403929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.436036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27845ab679f41728f1dbba4feb71e19', 'request_id': 'req-6f14dffe-07e2-45e4-86cb-325e2c5521d2'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.452525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27845ab679f41728f1dbba4feb71e19', 'request_id': 'req-6f14dffe-07e2-45e4-86cb-325e2c5521d2'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.464071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27845ab679f41728f1dbba4feb71e19', 'request_id': 'req-6f14dffe-07e2-45e4-86cb-325e2c5521d2'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.469909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] MFA Rules not processed for user `b983f50032274dfbb2cd62ab3d9c5a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:31.472220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:31.492022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] The token cache is being invalidate because project b27845ab679f41728f1dbba4feb71e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:31.492595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.494645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f14dffe-07e2-45e4-86cb-325e2c5521d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.497698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 998/1995] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:31 2022] DELETE /identity/v3/projects/b27845ab679f41728f1dbba4feb71e19 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:31.503699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5fed-2e34-4cfe-91a7-e5bbad2bf431 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.504080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5fed-2e34-4cfe-91a7-e5bbad2bf431 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.504604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5fed-2e34-4cfe-91a7-e5bbad2bf431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.551630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-19ef5fed-2e34-4cfe-91a7-e5bbad2bf431 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:31.554183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-19ef5fed-2e34-4cfe-91a7-e5bbad2bf431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:31.655197 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 998/1996] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:31.662787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.666208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:31.699991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 999/1997] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:31.702339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.702690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.702909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.727589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:31.728890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:31.759379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1000/1998] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:31.760512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.765987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd0238-3e9e-452c-b002-2a1114ad145d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.767881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:31.770406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.771431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.772523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.772915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.774170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d5526-4412-4e4c-9dc4-342967816fc9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.785542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.786251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.787229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.787742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.788613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:31.788978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.791004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.792513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.799109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.812559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1001/1999] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:31.813568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 999/2000] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:31 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:31.814006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.814766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.816715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:31.830011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d22d-7d6e-4c7a-8b72-20ece478028f service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.835149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcd2b3-e536-4341-88a5-9e8f203e72ef admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:31.837691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.838631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.839107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.839531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.840498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.843034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:31.843443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.843910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:31.844275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:31.844651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] PATH_INFO: `/v3/users/fdb85c9ae1bc477994e22212bc262958` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:31.846109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb85c9ae1bc477994e22212bc262958)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:31.848585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:31.854341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:31.905786 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1000/2001] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:31.910273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:31.946301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb85c9ae1bc477994e22212bc262958'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.961136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb85c9ae1bc477994e22212bc262958'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.972539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb85c9ae1bc477994e22212bc262958'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.974163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb85c9ae1bc477994e22212bc262958'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.992235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-436fa57f-0103-48b6-877b-1328ce15424d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb85c9ae1bc477994e22212bc262958'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:31.997009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c8fd-63cf-4695-a16c-6ffa1eb1b746 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.004755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.004978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1002/2002] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:31 2022] DELETE /identity/v3/users/fdb85c9ae1bc477994e22212bc262958 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:32.005066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.005066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.005066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.005835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.008987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.009240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.009517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.009793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.037022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:32.038324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.043787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1001/2003] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:31 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:32.049412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.051896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.076067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386c71e-12cd-422c-a604-7e6a0b9111e4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.126056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1003/2004] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:32.126932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.128422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.150261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.150995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.151384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.151889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.152641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.154330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.168810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1002/2005] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:32.168810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.170409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.203741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57e04-fb0e-44ee-a0d9-ee6d7ad74070 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.209428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.210074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.210556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.211408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.213657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.237632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:32.254836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8fa2-5f0e-4582-a9db-65b00756b50f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.260766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.262229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.262529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.262943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.276023 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.278076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.292388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1003/2006] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:32.292631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.293389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.294148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.306011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1004/2007] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:32 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:32.309191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f11d17-1465-49c4-8949-6797b21d6d18 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.315353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f1d17-76ec-4615-b72b-7f9b89cf45a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.315989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f1d17-76ec-4615-b72b-7f9b89cf45a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.316291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f1d17-76ec-4615-b72b-7f9b89cf45a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.316570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f1d17-76ec-4615-b72b-7f9b89cf45a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.317214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f1d17-76ec-4615-b72b-7f9b89cf45a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.319503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f1d17-76ec-4615-b72b-7f9b89cf45a5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.331083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1004/2008] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:32.335787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.347423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4475f-8916-4802-ad36-85da9b230398 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.354184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.355367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.355839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.356341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] PATH_INFO: `/v3/projects/a0e1e12cdf524d82ba48204f025a2067/users/5e0ce6bc01884def82e2b6118ba5a005/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.376332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e1e12cdf524d82ba48204f025a2067, user_id=5e0ce6bc01884def82e2b6118ba5a005, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.379788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.398904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1005/2009] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:32 2022] PUT /identity/v3/projects/a0e1e12cdf524d82ba48204f025a2067/users/5e0ce6bc01884def82e2b6118ba5a005/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:32.409676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.409991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.410232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.428461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:32.462334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] MFA Rules not processed for user `5e0ce6bc01884def82e2b6118ba5a005`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:32.463683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.595688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1005/2010] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:32.610009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.611823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.665758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.667723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.715176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3f49-864d-41b1-a01d-ee1f896d752a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.726137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.726687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.726936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.727309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.738146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.738480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.749984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1006/2011] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:32.778003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.778731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bfb2e-b2d9-4321-97b5-ca61903d48ff None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.783803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.784654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.785003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.785524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] PATH_INFO: `/v3/projects/627323b87c484cec9f3e3747e537f17b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.787058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627323b87c484cec9f3e3747e537f17b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.789668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.792857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea543-b053-404b-9061-80b7fd5a475f service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:32.798596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:32.799381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.800086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.800397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] PATH_INFO: `/v3/users/5e0ce6bc01884def82e2b6118ba5a005` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.804420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0ce6bc01884def82e2b6118ba5a005)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:32.807040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:32.854447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627323b87c484cec9f3e3747e537f17b', 'request_id': 'req-b387591a-de89-4553-a338-36494ec1ad46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.863789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627323b87c484cec9f3e3747e537f17b', 'request_id': 'req-b387591a-de89-4553-a338-36494ec1ad46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.872157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627323b87c484cec9f3e3747e537f17b', 'request_id': 'req-b387591a-de89-4553-a338-36494ec1ad46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.879108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0ce6bc01884def82e2b6118ba5a005'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.887214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] The token cache is being invalidate because project 627323b87c484cec9f3e3747e537f17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:32.887625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.888396 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.890645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1006/2012] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:32 2022] DELETE /identity/v3/projects/627323b87c484cec9f3e3747e537f17b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:32.894219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:32.895607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0ce6bc01884def82e2b6118ba5a005'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.898365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.905070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0ce6bc01884def82e2b6118ba5a005'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.905715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0ce6bc01884def82e2b6118ba5a005'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.912891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58ad1cb7-7f30-4b6b-b63a-a335081fccbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0ce6bc01884def82e2b6118ba5a005'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:32.919484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1007/2013] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:32 2022] DELETE /identity/v3/users/5e0ce6bc01884def82e2b6118ba5a005 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:32.923711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:32.924140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:32.924515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:32.953806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:32.959468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:32.960891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:32.965521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:33.030121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387591a-de89-4553-a338-36494ec1ad46 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:33.045560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1008/2014] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:33.049211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:33.049211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.059893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab991d-206a-4c8e-a9ab-3cf2fff202dd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:33.064595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:33.065316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.065660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.065995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] PATH_INFO: `/v3/users/dfa2616b5f8540ed9e3e90c48af042ce` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.067116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa2616b5f8540ed9e3e90c48af042ce)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:33.069332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:33.092146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:33.092825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.093103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.093442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] PATH_INFO: `/v3/users/c2d1b254b1d04a59aaf89f9e63f88c46` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.094628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d1b254b1d04a59aaf89f9e63f88c46)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:33.096801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:33.119102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa2616b5f8540ed9e3e90c48af042ce'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.134044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa2616b5f8540ed9e3e90c48af042ce'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.141436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa2616b5f8540ed9e3e90c48af042ce'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.142152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa2616b5f8540ed9e3e90c48af042ce'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.147209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d1b254b1d04a59aaf89f9e63f88c46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.150739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa2616b5f8540ed9e3e90c48af042ce'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.157279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d1b254b1d04a59aaf89f9e63f88c46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.157695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1009/2015] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:33 2022] DELETE /identity/v3/users/dfa2616b5f8540ed9e3e90c48af042ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:33.158298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d1b254b1d04a59aaf89f9e63f88c46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.159004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d1b254b1d04a59aaf89f9e63f88c46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.162320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:33.164064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.168031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a0b70eae-7c45-4d9e-8542-c8c83428009a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d1b254b1d04a59aaf89f9e63f88c46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:33.189413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1007/2016] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:32 2022] DELETE /identity/v3/users/c2d1b254b1d04a59aaf89f9e63f88c46 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:33.190851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.191831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.192112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.215824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:33.216163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.277641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219f2a-89b1-42c4-8b2e-6c61bea9862d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:33.283864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:33.303466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1008/2017] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:33.314769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:33.319424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.330083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:33.357006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:33.358132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.358707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.359158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.361442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.378832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:33.381692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:33.396943 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1010/2018] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:33.415889 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e2db7-5c27-4630-91fd-ee1fb3b838ce None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:33.420657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7352133-950a-44be-928b-9376580a430c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:33.421413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7352133-950a-44be-928b-9376580a430c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.421816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7352133-950a-44be-928b-9376580a430c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.422087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7352133-950a-44be-928b-9376580a430c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.435709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7352133-950a-44be-928b-9376580a430c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:33.438499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7352133-950a-44be-928b-9376580a430c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:33.455093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1009/2019] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:33.875161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:33.875666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7352133-950a-44be-928b-9376580a430c service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:33.876644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.877224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e7352133-950a-44be-928b-9376580a430c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:33.897820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310a7b0-2a2f-4ac0-8259-50462d30b254 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:33.909580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7352133-950a-44be-928b-9376580a430c service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:33.913582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:33.914231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.914507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.914772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] PATH_INFO: `/v3/projects/a0e1e12cdf524d82ba48204f025a2067` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.915951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e1e12cdf524d82ba48204f025a2067)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:33.917911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:33.921731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:33.923116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:33.923405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:33.924275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] PATH_INFO: `/v3/projects/2c537af69ef54e73b74cb2ef7e27a395` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:33.925277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c537af69ef54e73b74cb2ef7e27a395)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:33.929132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.012568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e1e12cdf524d82ba48204f025a2067', 'request_id': 'req-15146229-5ef6-4b60-a327-a4a66adc524a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.043685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e1e12cdf524d82ba48204f025a2067', 'request_id': 'req-15146229-5ef6-4b60-a327-a4a66adc524a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.048978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c537af69ef54e73b74cb2ef7e27a395', 'request_id': 'req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.055423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e1e12cdf524d82ba48204f025a2067', 'request_id': 'req-15146229-5ef6-4b60-a327-a4a66adc524a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.070704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c537af69ef54e73b74cb2ef7e27a395', 'request_id': 'req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.085120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] The token cache is being invalidate because project a0e1e12cdf524d82ba48204f025a2067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:34.085418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.087338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.090597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1011/2020] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:33 2022] DELETE /identity/v3/projects/a0e1e12cdf524d82ba48204f025a2067 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:34.094495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.097793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.099287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c537af69ef54e73b74cb2ef7e27a395', 'request_id': 'req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.148010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] The token cache is being invalidate because project 2c537af69ef54e73b74cb2ef7e27a395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:34.148010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.149922 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a8d9655f-035c-4e08-b9d4-b5c2b6df2757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.151850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1010/2021] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:33 2022] DELETE /identity/v3/projects/2c537af69ef54e73b74cb2ef7e27a395 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:34.153570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd762ae-32df-402c-a92f-9015a7a70ff0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.154437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd762ae-32df-402c-a92f-9015a7a70ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.155211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd762ae-32df-402c-a92f-9015a7a70ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.186085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ebd762ae-32df-402c-a92f-9015a7a70ff0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:34.187313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ebd762ae-32df-402c-a92f-9015a7a70ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.205217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146229-5ef6-4b60-a327-a4a66adc524a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.263804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1011/2022] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:34.274227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51a80-1388-42c8-969f-7fb49c1af047 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.274522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51a80-1388-42c8-969f-7fb49c1af047 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.274706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51a80-1388-42c8-969f-7fb49c1af047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.294247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.294982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.295259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.295526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] PATH_INFO: `/v3/projects/441c81a99ab84598823bf96d41c22ab8` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.296684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441c81a99ab84598823bf96d41c22ab8)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.297114 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dcc51a80-1388-42c8-969f-7fb49c1af047 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:34.298334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dcc51a80-1388-42c8-969f-7fb49c1af047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.298601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.307779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1012/2023] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:34.314875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005cbf-06db-4146-bed8-653c496f6118 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.314875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005cbf-06db-4146-bed8-653c496f6118 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.314875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005cbf-06db-4146-bed8-653c496f6118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.318483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:34.330776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-77005cbf-06db-4146-bed8-653c496f6118 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:34.332021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-77005cbf-06db-4146-bed8-653c496f6118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.343147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1013/2024] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:34.344568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.344954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.345333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.361036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:34.383384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:34.383579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441c81a99ab84598823bf96d41c22ab8', 'request_id': 'req-d72fb244-14e2-479f-833d-fd98137ae9e3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.384767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.393754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441c81a99ab84598823bf96d41c22ab8', 'request_id': 'req-d72fb244-14e2-479f-833d-fd98137ae9e3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.406472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441c81a99ab84598823bf96d41c22ab8', 'request_id': 'req-d72fb244-14e2-479f-833d-fd98137ae9e3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.426770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] The token cache is being invalidate because project 441c81a99ab84598823bf96d41c22ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:34.428051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.429587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.434213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1012/2025] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:34 2022] DELETE /identity/v3/projects/441c81a99ab84598823bf96d41c22ab8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:34.434213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.436281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.472712 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1014/2026] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:34.476450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.478044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.499208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795a565-13e5-4964-a772-360d5a83b9f9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.504110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.504716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.505002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.505343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] PATH_INFO: `/v3/users/8ff12f446d4b46fd8a32add079584701` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.506983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff12f446d4b46fd8a32add079584701)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.510341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.524111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fb244-14e2-479f-833d-fd98137ae9e3 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.535189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.535816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.537085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.537368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.539230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:34.539533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.541325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.558768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1013/2027] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:34.559768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.574258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62295d2-ab79-4c3d-98d2-c2c0d14add4f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.588020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.589674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.590426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.590745 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.592655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:34.592992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.593733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff12f446d4b46fd8a32add079584701'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.595206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.611713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff12f446d4b46fd8a32add079584701'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.612427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff12f446d4b46fd8a32add079584701'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.613061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff12f446d4b46fd8a32add079584701'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.634040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1014/2028] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:34.635302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.636216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff12f446d4b46fd8a32add079584701'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:34.637550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.698164 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d1c0-b7dd-40c7-a908-d42f70f3110f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.706962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.707606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.710163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.710163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.710810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.729493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.729870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1015/2029] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:34 2022] DELETE /identity/v3/users/8ff12f446d4b46fd8a32add079584701 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:34.733137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.737349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:34.822127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1015/2030] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:34.823874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.894660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72de61b-8d6f-4e67-84c4-c20d49bc3177 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.915427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9855a-0ace-4b5e-95e0-8933f7c43ab6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.920635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.921245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.921525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.921794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.922831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.923909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:34.925085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.934564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:34.952370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1016/2031] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:34.955926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:34.977244 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75734793-108e-45fd-9dd5-aaf21c268f10 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:34.982639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.983239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.983512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.983831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.984514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.986095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.987983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:34.989081 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:34.989515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:34.990035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:34.991133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:34.993725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:34.998007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1017/2032] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:35.005633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.017339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c3dc-be65-4058-b147-48043f6e7bf5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.023018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.023633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.023945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.024208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.024895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.026561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.027594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1016/2033] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:34 2022] POST /identity/v3/projects => generated 361 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:35.032182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.039484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1018/2034] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:35.043741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.054824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8af53-b087-4599-916c-07720d024551 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.105861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f790f-c81c-426d-8a1b-b9fdd4d0777f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.112585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.113233 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.113676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.113808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.114910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.117000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.121103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321af882-9130-4bc0-befb-02339f724896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.121984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321af882-9130-4bc0-befb-02339f724896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.122109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321af882-9130-4bc0-befb-02339f724896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.122330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321af882-9130-4bc0-befb-02339f724896 admin admin] PATH_INFO: `/v3/projects/2ec4b900ecb941b0988cd1d1793bc85f/users/9816bf0dcdcb443fb0cdfa25984bb746/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.139234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321af882-9130-4bc0-befb-02339f724896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec4b900ecb941b0988cd1d1793bc85f, user_id=9816bf0dcdcb443fb0cdfa25984bb746, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.143817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1017/2035] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:35 2022] POST /identity/v3/users => generated 281 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:35.143969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321af882-9130-4bc0-befb-02339f724896 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.144972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.156327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90f63-2598-4f75-ace4-0b0ba99d6d5c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.159871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1019/2036] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:35 2022] PUT /identity/v3/projects/2ec4b900ecb941b0988cd1d1793bc85f/users/9816bf0dcdcb443fb0cdfa25984bb746/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:35.165092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.165502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.165891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.187192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:35.188722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.257317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.257959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.258241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.258513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.259167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.260794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.272284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1018/2037] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:35.275773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.286531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaec62-cfec-47da-8d23-a8e315f886a3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.296696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.297351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.297979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.298171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.299333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.301811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.316735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1019/2038] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:35.320954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.326256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1020/2039] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:35.334177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2dd2-07dc-45b4-bf3f-d47e508701df admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.340928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.352411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.354616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.354838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.355236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.355988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] PATH_INFO: `/v3/projects/97ea9698466b4f52bdc009cf4d5ba05f/users/43d4385bb0404c42a666381cd2b29ac7/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.383562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ea9698466b4f52bdc009cf4d5ba05f, user_id=43d4385bb0404c42a666381cd2b29ac7, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.386970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.401540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:35.409478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1020/2040] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:35 2022] PUT /identity/v3/projects/97ea9698466b4f52bdc009cf4d5ba05f/users/43d4385bb0404c42a666381cd2b29ac7/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:35.420389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.422749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.481712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700c39c-7186-43e5-8606-289d104f9a96 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.493013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:35.585171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3b73-4b38-4a30-ad02-20affcb2fcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.586606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3b73-4b38-4a30-ad02-20affcb2fcae service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.587002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3b73-4b38-4a30-ad02-20affcb2fcae service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.587377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3b73-4b38-4a30-ad02-20affcb2fcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.592721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae21d3-a0df-4c05-9e5b-ddd0bf8d6643 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.616988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d3b73-4b38-4a30-ad02-20affcb2fcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.617231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.621889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d3b73-4b38-4a30-ad02-20affcb2fcae service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.622864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.623340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.623737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] PATH_INFO: `/v3/projects/78f54cc7a63c4ffd902fecef31e80578` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.631430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f54cc7a63c4ffd902fecef31e80578)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.634731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:35.657693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1021/2041] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:35.659605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.660037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.660484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.720905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] MFA Rules not processed for user `43d4385bb0404c42a666381cd2b29ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:35.722328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.735878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f54cc7a63c4ffd902fecef31e80578', 'request_id': 'req-0719ac38-9015-4a1f-be65-f3017d3a751c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:35.745213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f54cc7a63c4ffd902fecef31e80578', 'request_id': 'req-0719ac38-9015-4a1f-be65-f3017d3a751c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:35.754931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f54cc7a63c4ffd902fecef31e80578', 'request_id': 'req-0719ac38-9015-4a1f-be65-f3017d3a751c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:35.775968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] The token cache is being invalidate because project 78f54cc7a63c4ffd902fecef31e80578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:35.776362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:35.776981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0719ac38-9015-4a1f-be65-f3017d3a751c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:35.779204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1021/2042] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:35 2022] DELETE /identity/v3/projects/78f54cc7a63c4ffd902fecef31e80578 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:35.784317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795b232-acfe-4685-90f7-5f202099df2b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.784626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795b232-acfe-4685-90f7-5f202099df2b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.785110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795b232-acfe-4685-90f7-5f202099df2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.811994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7795b232-acfe-4685-90f7-5f202099df2b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:35.812924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7795b232-acfe-4685-90f7-5f202099df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.814274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1022/2043] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:35.856343 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.858372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.916106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1022/2044] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:35.917928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.918425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.919588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.960606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b474948-eda4-4ca2-89aa-1902caeea784 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:35.967042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:35.967837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:35.968196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:35.968506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:35.969848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:35.971088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:35.983274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1023/2045] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:35.984411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:35.996717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:35.998628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.001230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30971795-a97a-4e1b-9525-3639ab47cb76 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.006987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.009806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.010244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.010565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.011617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:36.012027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.014658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.033193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1023/2046] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:36.040432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.043844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:36.063487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1024/2047] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:36.065552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.087147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd680-71b2-4a65-ab5f-94b3bab71137 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.091799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce6fb-86f8-439a-a0c1-ee692ab63cdc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.098411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.100029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.101128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.101759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.101882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.102044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.102324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.102968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.103078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] PATH_INFO: `/v3/users/43d4385bb0404c42a666381cd2b29ac7` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.106886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d4385bb0404c42a666381cd2b29ac7)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.108536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.113247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.143162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:36.187555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1025/2048] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:36 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:36.190247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.198165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:36.215174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d4385bb0404c42a666381cd2b29ac7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:36.232013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d4385bb0404c42a666381cd2b29ac7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:36.257410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d4385bb0404c42a666381cd2b29ac7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:36.258053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d4385bb0404c42a666381cd2b29ac7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:36.267397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-62bc2189-1ddc-419a-aaf0-c9d175905dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d4385bb0404c42a666381cd2b29ac7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:36.275457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1024/2049] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:36 2022] DELETE /identity/v3/users/43d4385bb0404c42a666381cd2b29ac7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:36.280613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.281060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.281479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.303725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3aa8b-1b21-4076-af96-265030de55b6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.312656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:36.314236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:36.398910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.398910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.398910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.398910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.399393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.400211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1025/2050] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:36.403236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.405770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.407454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:36.443207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1026/2051] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:36 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:36.447585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.449978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:36.467999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28b8f-ec26-43b2-a79e-c13482278cb6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.475653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.476796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.477399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.477939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.478742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.480931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.495626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048ce5d-10e2-48b3-9ed6-f492ffe24549 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.498893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1027/2052] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:36.499931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.501588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.502221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.502496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.502774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.516618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277bfc0-1752-4bbf-aa28-2f9fc3aa8507 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.518634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.521403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.533859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1026/2053] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:36.540157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c007522-eb42-4e7d-89f6-01899f82bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.540846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007522-eb42-4e7d-89f6-01899f82bdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.541126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007522-eb42-4e7d-89f6-01899f82bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.541401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007522-eb42-4e7d-89f6-01899f82bdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.542538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c007522-eb42-4e7d-89f6-01899f82bdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.544210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c007522-eb42-4e7d-89f6-01899f82bdb8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.558623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1028/2054] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:36.562755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.583872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179f0f8-85cc-48dd-97ea-9dcccc3ab384 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:36.601202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:36.601954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.602372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.602657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] PATH_INFO: `/v3/projects/c2efb2c13d774a76b63c1aefe2e43ab0/users/7ec2814ade9b45439928a4de4c8967b5/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.647070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2efb2c13d774a76b63c1aefe2e43ab0, user_id=7ec2814ade9b45439928a4de4c8967b5, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:36.650388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:36.677735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1027/2055] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:36 2022] PUT /identity/v3/projects/c2efb2c13d774a76b63c1aefe2e43ab0/users/7ec2814ade9b45439928a4de4c8967b5/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:36.680085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:36.680623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:36.681689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:36.805406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] MFA Rules not processed for user `7ec2814ade9b45439928a4de4c8967b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:36.806645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:36.930641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:36.949858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:36.951988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1029/2056] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:36.998915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:37.061354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdfdc2-e4ea-48c4-80e5-d2c0609c5eee admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:37.069825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:37.070712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.071428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.071633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.072409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:37.074475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:37.111792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1028/2057] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:36 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:37.113359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:37.126454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933d29b-e1c8-47c5-9693-d00655126c82 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:37.263583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:37.264215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.264636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.264816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.265424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:37.268581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:37.318262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1030/2058] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:37 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:37.320510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:37.350227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436201-cd08-4691-bb80-a462bd441454 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:37.356488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:37.357290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.357682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.358106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.358886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:37.361047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:37.393834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1029/2059] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:37.398255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:37.413412 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172504f2-a6a3-4bb0-8bc6-154367c102ee admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:37.427133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4b12b-56ec-46f9-bf9d-af44feba2978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:37.428053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4b12b-56ec-46f9-bf9d-af44feba2978 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.428520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4b12b-56ec-46f9-bf9d-af44feba2978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.428976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4b12b-56ec-46f9-bf9d-af44feba2978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.429773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4b12b-56ec-46f9-bf9d-af44feba2978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:37.432502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4b12b-56ec-46f9-bf9d-af44feba2978 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:37.447323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1031/2060] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:37.451332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:37.465853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701aba3-f143-41ab-84dd-c19ebb42c5b6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:37.474571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217556d-70d5-4131-ae27-107a6bfb917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:37.475734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217556d-70d5-4131-ae27-107a6bfb917f admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.476387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217556d-70d5-4131-ae27-107a6bfb917f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.476991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217556d-70d5-4131-ae27-107a6bfb917f admin admin] PATH_INFO: `/v3/projects/84ff3f4cbd6a4528b8d32d86e1c0442a/users/0380b0c33cd24f7c96291c8c1b357311/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.533787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217556d-70d5-4131-ae27-107a6bfb917f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ff3f4cbd6a4528b8d32d86e1c0442a, user_id=0380b0c33cd24f7c96291c8c1b357311, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:37.538180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217556d-70d5-4131-ae27-107a6bfb917f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:37.568014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1030/2061] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:37 2022] PUT /identity/v3/projects/84ff3f4cbd6a4528b8d32d86e1c0442a/users/0380b0c33cd24f7c96291c8c1b357311/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:37.585264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.585628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.586718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.642147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] MFA Rules not processed for user `0380b0c33cd24f7c96291c8c1b357311`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:37.643492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:37.748777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.749178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.749816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.783856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1032/2062] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:37.785940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:37.826722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] MFA Rules not processed for user `9816bf0dcdcb443fb0cdfa25984bb746`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:37.830027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:37.946558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f5ff7-9a32-4360-a600-7c052520d020 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:37.955135 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:37.956626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:37.957086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:37.959989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:37.961203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:37.963977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:37.973163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:37.991060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1031/2063] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:37.993383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:37.996797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.018650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a3dec-bd0b-4736-aee1-306a142e7360 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.024232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.024948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.025232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.025510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] PATH_INFO: `/v3/projects/97ea9698466b4f52bdc009cf4d5ba05f` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.026942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ea9698466b4f52bdc009cf4d5ba05f)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.028655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1033/2064] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:37 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:38.028966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.029572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.033834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.094239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ea9698466b4f52bdc009cf4d5ba05f', 'request_id': 'req-8fe9b689-b984-47b0-aac5-cbf8c21540c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.103533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ea9698466b4f52bdc009cf4d5ba05f', 'request_id': 'req-8fe9b689-b984-47b0-aac5-cbf8c21540c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.111568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ea9698466b4f52bdc009cf4d5ba05f', 'request_id': 'req-8fe9b689-b984-47b0-aac5-cbf8c21540c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.114276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:38.122871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893229e3-f681-45a6-993f-a33952e8507d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.130446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] The token cache is being invalidate because project 97ea9698466b4f52bdc009cf4d5ba05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:38.130745 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.131542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.133442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1032/2065] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:37 2022] DELETE /identity/v3/projects/97ea9698466b4f52bdc009cf4d5ba05f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:38.137384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.147787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.204813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.206171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.206668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.207179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.210950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.240750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b689-b984-47b0-aac5-cbf8c21540c6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.248668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.249027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.249360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.249646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.250293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.252311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.290725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1033/2066] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:38 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:38.292123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.298275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.299745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.309231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46701fbf-6213-407c-a1ca-45e7b91d625a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.311670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1034/2067] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:38.315660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.316475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.316852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.317195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.318821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.320763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.335191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1034/2068] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:38.339354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.352656 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6700287-128c-4cb2-9ea0-3ed3e8febea0 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.359499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.360520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.360808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.361910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] PATH_INFO: `/v3/projects/fec050fbd67547828250a9855d2af485/users/43f2d4cde0164ddfb189e1a094a2c08c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.386650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec050fbd67547828250a9855d2af485, user_id=43f2d4cde0164ddfb189e1a094a2c08c, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.389400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.407405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1035/2069] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:38 2022] PUT /identity/v3/projects/fec050fbd67547828250a9855d2af485/users/43f2d4cde0164ddfb189e1a094a2c08c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:38.412742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.426076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855448e3-7811-466a-a926-ef7a93132322 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.522148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4fd24-4ea3-46c8-b22e-a05be55929fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.522824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4fd24-4ea3-46c8-b22e-a05be55929fb admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.523193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4fd24-4ea3-46c8-b22e-a05be55929fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.523508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4fd24-4ea3-46c8-b22e-a05be55929fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.524284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4fd24-4ea3-46c8-b22e-a05be55929fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.526175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4fd24-4ea3-46c8-b22e-a05be55929fb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.540037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1035/2070] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:38.544902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.560149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970f9a2-e769-46f6-a5c1-6ddbb5ff3bee admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.569239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.570112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.570434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.570881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] PATH_INFO: `/v3/projects/fec050fbd67547828250a9855d2af485/users/43f2d4cde0164ddfb189e1a094a2c08c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.577297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec050fbd67547828250a9855d2af485, user_id=43f2d4cde0164ddfb189e1a094a2c08c, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.580049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.603532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1036/2071] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:38 2022] PUT /identity/v3/projects/fec050fbd67547828250a9855d2af485/users/43f2d4cde0164ddfb189e1a094a2c08c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:38.617090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.617377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.617652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.701133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.703555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.703872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] MFA Rules not processed for user `43f2d4cde0164ddfb189e1a094a2c08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:38.705135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.748320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:38.816910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:38.822858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae634b-f09c-4b97-83cf-ce522e8763dc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.829291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.830009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.830300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.830579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] PATH_INFO: `/v3/users/75a83917bf4f4d718386334d0a9147af` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.831770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a83917bf4f4d718386334d0a9147af)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:38.834132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1036/2072] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:38.834999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:38.847928 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:38.850795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.906130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a83917bf4f4d718386334d0a9147af'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.915966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a83917bf4f4d718386334d0a9147af'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.917718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a83917bf4f4d718386334d0a9147af'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.918508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a83917bf4f4d718386334d0a9147af'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.928238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4b02b-816f-46d6-b977-0e2e43d77dac None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:38.931827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-77ab10b0-7161-4005-94ee-bc2db4d71bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a83917bf4f4d718386334d0a9147af'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:38.934077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:38.935176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.936200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.936651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.938790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:38.961516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1037/2073] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:38 2022] DELETE /identity/v3/users/75a83917bf4f4d718386334d0a9147af => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:38.963442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:38.963727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:38.963997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:38.995957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:38.997291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:39.021774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:39.023813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:39.035128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1037/2074] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:39.078860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1038/2075] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:39.091927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:39.093697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:39.180720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147287da-a484-483f-ade8-9505a0d4add2 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:39.238862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:39.239528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:39.240287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:39.240287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:39.256527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:39.256527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:39.263965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1038/2076] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:39.540427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:39.542077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:39.555860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04bcce-b69c-4b9c-868c-4faec9328e55 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:39.560641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:39.561418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:39.561680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:39.562097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] PATH_INFO: `/v3/projects/ec43415483ef44b195339f34641fb438` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:39.563238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec43415483ef44b195339f34641fb438)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:39.565230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:39.602942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:39.614005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec43415483ef44b195339f34641fb438', 'request_id': 'req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.621175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec43415483ef44b195339f34641fb438', 'request_id': 'req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.626698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec43415483ef44b195339f34641fb438', 'request_id': 'req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.639633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] The token cache is being invalidate because project ec43415483ef44b195339f34641fb438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:39.639917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.640549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-30cb7c0a-01e2-41c1-bd25-2a6ba1adb3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.642072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1039/2077] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:39 2022] DELETE /identity/v3/projects/ec43415483ef44b195339f34641fb438 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:39.646150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:39.655797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975b79-5701-4d68-af2b-327711691436 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:39.660299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:39.716007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:39.716695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:39.716977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:39.717248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] PATH_INFO: `/v3/users/b983f50032274dfbb2cd62ab3d9c5a21` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:39.718359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b983f50032274dfbb2cd62ab3d9c5a21)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:39.720315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:39.768207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b983f50032274dfbb2cd62ab3d9c5a21'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.780415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b983f50032274dfbb2cd62ab3d9c5a21'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.787971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b983f50032274dfbb2cd62ab3d9c5a21'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.788571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b983f50032274dfbb2cd62ab3d9c5a21'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.795945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b983f50032274dfbb2cd62ab3d9c5a21'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:39.800716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:39.801007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:39.801377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:39.809724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1039/2078] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:39 2022] DELETE /identity/v3/users/b983f50032274dfbb2cd62ab3d9c5a21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:39.834247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] MFA Rules not processed for user `9816bf0dcdcb443fb0cdfa25984bb746`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:39.835864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:39.919091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1040/2079] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:40.489025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:40.496461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:40.655901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245db4-369d-4fe5-86e6-e1df93ee5a5a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:40.660983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:40.662319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:40.662601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:40.662871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] PATH_INFO: `/v3/projects/53d529da2de84f8399e525f1cd05c05e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:40.664003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d529da2de84f8399e525f1cd05c05e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:40.666023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:40.718210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:40.739981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:40.741260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d529da2de84f8399e525f1cd05c05e', 'request_id': 'req-70944121-fb56-4012-b09a-43fc6a456fd4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:40.741589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:40.752101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d529da2de84f8399e525f1cd05c05e', 'request_id': 'req-70944121-fb56-4012-b09a-43fc6a456fd4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:40.762534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d529da2de84f8399e525f1cd05c05e', 'request_id': 'req-70944121-fb56-4012-b09a-43fc6a456fd4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:40.777906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] The token cache is being invalidate because project 53d529da2de84f8399e525f1cd05c05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:40.778232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:40.778894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-70944121-fb56-4012-b09a-43fc6a456fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:40.781248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1040/2080] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:40 2022] DELETE /identity/v3/projects/53d529da2de84f8399e525f1cd05c05e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:40.785852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffd1d4-8c55-4652-a622-cbfa3cac79e9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:40.786408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffd1d4-8c55-4652-a622-cbfa3cac79e9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:40.786970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffd1d4-8c55-4652-a622-cbfa3cac79e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:40.811048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-34ffd1d4-8c55-4652-a622-cbfa3cac79e9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:40.811977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feaf45-9f79-4cf5-a105-5ed536334685 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:40.813201 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-34ffd1d4-8c55-4652-a622-cbfa3cac79e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:40.874221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:40.874806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:40.875052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:40.875458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:40.877565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:40.900458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1041/2081] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:40.910452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:40.910883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:40.924012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:40.936766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:40.938102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:40.946702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1042/2082] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:40.950862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:40.954239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:40.964770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7d4e-0d6d-4250-9a35-a23eaec987ea None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:40.971319 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:40.972000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:40.972456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:40.972842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:40.974229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:40.974732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:40.977050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:40.994140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1043/2083] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:27:40.995170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.010093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.011628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.022373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1041/2084] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:41.022876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa9e46-73c0-4624-a450-27f2f2117107 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:41.028910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:41.029527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.029806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.030088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.030775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.032731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.077426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1044/2085] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:40 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:41.081307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.093699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1738-7fa8-4f0b-a4bc-f0ee91a4f5a2 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:41.168543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:41.169316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.169598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.169935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.170707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.172868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.226182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1042/2086] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:41 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:27:41.230231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.258987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14741e-7bbe-4a31-916c-70282eb3867a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:41.281571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:41.282205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.282483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.282754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.283407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.285041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.322488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1045/2087] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:41.326602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.340941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d142e6-3db3-4a22-813a-2323b9acc32f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:41.347432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa71ec-3ff4-4496-8c4f-9483f1988ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:41.349449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa71ec-3ff4-4496-8c4f-9483f1988ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.349600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa71ec-3ff4-4496-8c4f-9483f1988ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.353220 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa71ec-3ff4-4496-8c4f-9483f1988ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.354012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa71ec-3ff4-4496-8c4f-9483f1988ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.355640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa71ec-3ff4-4496-8c4f-9483f1988ebd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.372134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1043/2088] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:41.373231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.385955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5908-56df-425c-aa1d-54e4db1781a4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:41.391188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:41.392041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.392457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.392784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] PATH_INFO: `/v3/projects/dcfaadb0209f46fdb25607c72edc22af/users/25a3150713c2445aab942b4bb0d99e1f/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.418603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfaadb0209f46fdb25607c72edc22af, user_id=25a3150713c2445aab942b4bb0d99e1f, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.422655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.446574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1046/2089] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:41 2022] PUT /identity/v3/projects/dcfaadb0209f46fdb25607c72edc22af/users/25a3150713c2445aab942b4bb0d99e1f/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:41.451736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.452156 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.452345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.496691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:41.497966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:41.654995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1044/2090] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:41.741230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.743940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:41.840622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:41.864099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e359-1641-43a6-a017-81150f7bce35 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:41.869109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f356e-01aa-4894-94c8-a1c856641124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:41.870222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f356e-01aa-4894-94c8-a1c856641124 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:41.870686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f356e-01aa-4894-94c8-a1c856641124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:41.871154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f356e-01aa-4894-94c8-a1c856641124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:41.885164 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f356e-01aa-4894-94c8-a1c856641124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:41.886696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f356e-01aa-4894-94c8-a1c856641124 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:41.902974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1047/2091] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:41.948697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:41.950636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:42.016800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a953-b29e-4e69-9563-953330f627f8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:42.022683 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:42.023364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:42.023647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:42.023916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:42.027094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:42.044931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:42.116857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:42.118698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:42.132784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1045/2092] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:43.970612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:43.971157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:43.971312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:44.065759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] MFA Rules not processed for user `25a3150713c2445aab942b4bb0d99e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:44.067111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:44.358043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1048/2093] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:44.362267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:44.388420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a97677-0286-46a0-b1f2-9924fe20d60e service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:44.404014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:44.404664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:44.404949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:44.405224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:44.406883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:44.408172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:44.492933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1046/2094] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:44 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:44.497363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:44.522444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0779b-1aed-413d-97e3-6d81dc7e0d6d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:44.634980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:44.636669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:44.644497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:44.645082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:44.646955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:44.649973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:44.711990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1049/2095] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:44 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:44.712185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:44.727604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0d41b-3e1d-4406-84c0-b90474a35f70 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:44.743191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:44.747309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:44.747804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:44.748341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:44.749099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:44.752512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:44.779225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1047/2096] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:44.783478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:44.797305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c246-e640-42d8-8e96-f57e5b29a0f9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:44.805071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:44.805968 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:44.806249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:44.806580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] PATH_INFO: `/v3/projects/28a4ba2803054b8faf530a63313d5b05/users/957715fdd354424c93bbc689ab164a0c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:44.828612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a4ba2803054b8faf530a63313d5b05, user_id=957715fdd354424c93bbc689ab164a0c, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:44.832503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:44.864471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1050/2097] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:44 2022] PUT /identity/v3/projects/28a4ba2803054b8faf530a63313d5b05/users/957715fdd354424c93bbc689ab164a0c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:44.865552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:44.878930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d55c-4a26-43d8-89d6-508523c65a38 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:44.987132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5a437-1df9-45ef-8a7a-7ad4ec684808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:44.988497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a437-1df9-45ef-8a7a-7ad4ec684808 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:44.988497 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a437-1df9-45ef-8a7a-7ad4ec684808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:44.989932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a437-1df9-45ef-8a7a-7ad4ec684808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:44.990717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5a437-1df9-45ef-8a7a-7ad4ec684808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:44.992937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5a437-1df9-45ef-8a7a-7ad4ec684808 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:45.026710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1048/2098] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:45.030644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:45.049573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db991b1-b28d-4bf2-9d2c-71340ec84f18 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:45.062619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b84e9-8e33-4a22-8327-41e2fcf040f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:45.063302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b84e9-8e33-4a22-8327-41e2fcf040f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:45.063578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b84e9-8e33-4a22-8327-41e2fcf040f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:45.063847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b84e9-8e33-4a22-8327-41e2fcf040f9 admin admin] PATH_INFO: `/v3/projects/28a4ba2803054b8faf530a63313d5b05/users/957715fdd354424c93bbc689ab164a0c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:45.066587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b84e9-8e33-4a22-8327-41e2fcf040f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a4ba2803054b8faf530a63313d5b05, user_id=957715fdd354424c93bbc689ab164a0c, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:45.069924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b84e9-8e33-4a22-8327-41e2fcf040f9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:45.087600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1051/2099] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:45 2022] PUT /identity/v3/projects/28a4ba2803054b8faf530a63313d5b05/users/957715fdd354424c93bbc689ab164a0c/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:46.200538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:46.201571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:46.202124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:46.237181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] MFA Rules not processed for user `957715fdd354424c93bbc689ab164a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:46.238724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:46.324806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:46.341047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1049/2100] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:46.352200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:46.353263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:46.353745 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:46.374042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] MFA Rules not processed for user `25a3150713c2445aab942b4bb0d99e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:46.375668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:46.401875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:46.454589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1052/2101] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:46.462831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:46.464571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:46.571093 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:46.573687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:46.627035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7f437-43a8-477d-871f-c12e1526286c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:46.635671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d78f1-7467-4c5e-bc9c-99a560dc03cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:46.636543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d78f1-7467-4c5e-bc9c-99a560dc03cb service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:46.636826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d78f1-7467-4c5e-bc9c-99a560dc03cb service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:46.637101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d78f1-7467-4c5e-bc9c-99a560dc03cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:46.648166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d78f1-7467-4c5e-bc9c-99a560dc03cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:46.650028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d78f1-7467-4c5e-bc9c-99a560dc03cb service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:46.669974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1050/2102] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:27:46.679167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3cc08-e657-4ffd-959e-56d6dc178788 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:46.684385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:46.685324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:46.685706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:46.686081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] PATH_INFO: `/v3/users/7ec2814ade9b45439928a4de4c8967b5` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:46.687357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec2814ade9b45439928a4de4c8967b5)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:46.691086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:46.760258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec2814ade9b45439928a4de4c8967b5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:46.778610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec2814ade9b45439928a4de4c8967b5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:46.789999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec2814ade9b45439928a4de4c8967b5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:46.790725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec2814ade9b45439928a4de4c8967b5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:46.811713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec2814ade9b45439928a4de4c8967b5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:46.820821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1053/2103] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:46 2022] DELETE /identity/v3/users/7ec2814ade9b45439928a4de4c8967b5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:46.825045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:46.825333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:46.825617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:46.863823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:46.866158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:46.938213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1051/2104] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:46.961500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:46.965466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:47.049472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7cad7-59a5-4dea-839a-ea4149b952c5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:47.055066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:47.055776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:47.056128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:47.056608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:47.064387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:47.076944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:47.078504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:47.091307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1054/2105] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:47.777870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:47.779753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:47.825750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfde46-26d3-4ce6-a170-7c8d06440985 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:47.845182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:47.847783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:47.860996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:47.861441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] PATH_INFO: `/v3/projects/c2efb2c13d774a76b63c1aefe2e43ab0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:47.864741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2efb2c13d774a76b63c1aefe2e43ab0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:47.868571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:47.971105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2efb2c13d774a76b63c1aefe2e43ab0', 'request_id': 'req-76049adc-34b4-4bda-9017-73c40a357156'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:47.980547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2efb2c13d774a76b63c1aefe2e43ab0', 'request_id': 'req-76049adc-34b4-4bda-9017-73c40a357156'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:47.988331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2efb2c13d774a76b63c1aefe2e43ab0', 'request_id': 'req-76049adc-34b4-4bda-9017-73c40a357156'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.019089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] The token cache is being invalidate because project c2efb2c13d774a76b63c1aefe2e43ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:48.019815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.020963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.027099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1052/2106] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:47 2022] DELETE /identity/v3/projects/c2efb2c13d774a76b63c1aefe2e43ab0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:48.027389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:48.041081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65def6-5ff2-48e7-891d-1712785dd297 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:48.124402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:48.125120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:48.125473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:48.125827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] PATH_INFO: `/v3/users/0380b0c33cd24f7c96291c8c1b357311` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:48.127087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0380b0c33cd24f7c96291c8c1b357311)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:48.129328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:48.199723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0380b0c33cd24f7c96291c8c1b357311'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.224127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0380b0c33cd24f7c96291c8c1b357311'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.237891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0380b0c33cd24f7c96291c8c1b357311'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.238497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0380b0c33cd24f7c96291c8c1b357311'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.246871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0380b0c33cd24f7c96291c8c1b357311'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.256286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1055/2107] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:48 2022] DELETE /identity/v3/users/0380b0c33cd24f7c96291c8c1b357311 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:48.576842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:48.579092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:48.592292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:48.596990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049adc-34b4-4bda-9017-73c40a357156 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:48.679173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:48.679840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:48.680207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:48.680504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] PATH_INFO: `/v3/projects/84ff3f4cbd6a4528b8d32d86e1c0442a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:48.682325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ff3f4cbd6a4528b8d32d86e1c0442a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:48.684367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:48.736701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ff3f4cbd6a4528b8d32d86e1c0442a', 'request_id': 'req-6b995cea-167d-4f69-a933-3e49b5979fcc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.753303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ff3f4cbd6a4528b8d32d86e1c0442a', 'request_id': 'req-6b995cea-167d-4f69-a933-3e49b5979fcc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.759495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ff3f4cbd6a4528b8d32d86e1c0442a', 'request_id': 'req-6b995cea-167d-4f69-a933-3e49b5979fcc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.772878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] The token cache is being invalidate because project 84ff3f4cbd6a4528b8d32d86e1c0442a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:48.773280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.773980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.775655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1053/2108] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:48 2022] DELETE /identity/v3/projects/84ff3f4cbd6a4528b8d32d86e1c0442a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:27:48.779618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:48.781179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:48.794812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4038772-8add-4581-8cf9-419e2c29475b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:48.862495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:48.863145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:48.863427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:48.863700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] PATH_INFO: `/v3/users/43f2d4cde0164ddfb189e1a094a2c08c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:48.865561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f2d4cde0164ddfb189e1a094a2c08c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:48.870989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:48.889691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:48.934539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f2d4cde0164ddfb189e1a094a2c08c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.955042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f2d4cde0164ddfb189e1a094a2c08c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.964558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f2d4cde0164ddfb189e1a094a2c08c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.965618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f2d4cde0164ddfb189e1a094a2c08c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.976089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-df85185a-0d55-4fee-beba-a8b7e9543101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f2d4cde0164ddfb189e1a094a2c08c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:48.983577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1056/2109] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:48 2022] DELETE /identity/v3/users/43f2d4cde0164ddfb189e1a094a2c08c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:49.303624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:49.306604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:49.325642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995cea-167d-4f69-a933-3e49b5979fcc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:49.399434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:49.400854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:49.400936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:49.401263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] PATH_INFO: `/v3/projects/fec050fbd67547828250a9855d2af485` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:49.402490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec050fbd67547828250a9855d2af485)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:49.404530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:49.476290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:49.494440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec050fbd67547828250a9855d2af485', 'request_id': 'req-0524d28a-1e77-4498-b91c-0ba84ae6ca73'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:49.501565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec050fbd67547828250a9855d2af485', 'request_id': 'req-0524d28a-1e77-4498-b91c-0ba84ae6ca73'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:49.511121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec050fbd67547828250a9855d2af485', 'request_id': 'req-0524d28a-1e77-4498-b91c-0ba84ae6ca73'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:49.527710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] The token cache is being invalidate because project fec050fbd67547828250a9855d2af485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:49.528007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:49.528672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0524d28a-1e77-4498-b91c-0ba84ae6ca73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:49.530516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1054/2110] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:49 2022] DELETE /identity/v3/projects/fec050fbd67547828250a9855d2af485 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:49.536673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:49.537421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:49.537421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:49.562726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:49.564234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:49.649457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1057/2111] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:27:49.659467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:49.659788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:49.660033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:49.690778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:49.692902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:49.702466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1055/2112] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:49.706596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:49.719249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5735-d504-41cb-8019-5d10be44d099 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:49.727534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:49.728402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:49.728751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:49.729248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:49.729988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:49.730362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:49.732122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:49.761261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:49.767936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1058/2113] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:49.773048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe290-0bae-4423-87f1-2b2eb3295b60 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:49.778403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:49.779142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:49.779486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:49.779921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:49.780677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:49.783100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:49.845253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1056/2114] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:49 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:49.851718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:49.863502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1a47-710d-48a6-a41f-3be6e0fa74c9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:49.985375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:49.985678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:49.986100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:49.986402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:49.988503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:49.990736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:50.033453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1059/2115] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:49 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:50.038116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:50.050717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff36ab-8dec-4a07-a540-3b6a1c381bcd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:50.056311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:50.057028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:50.057395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:50.057738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:50.058451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:50.060160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:50.072430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1057/2116] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:50.075615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:50.088589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd61ac-5f4d-475d-8111-c1094f4a0b40 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:50.094670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5bf00-3cf4-40d0-b534-a83172f9c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:50.095371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5bf00-3cf4-40d0-b534-a83172f9c119 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:50.095655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5bf00-3cf4-40d0-b534-a83172f9c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:50.095930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5bf00-3cf4-40d0-b534-a83172f9c119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:50.096613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5bf00-3cf4-40d0-b534-a83172f9c119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:50.098214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5bf00-3cf4-40d0-b534-a83172f9c119 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:50.104809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:50.116265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1060/2117] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:27:50.120438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:50.131498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099290c2-5e5b-4c05-b8b6-b8aaa90aebaa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:50.137823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:50.138511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:50.138864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:50.139065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] PATH_INFO: `/v3/projects/dfa66c90ff094739a15a781401254921/users/cb73a1fbe5d5479d83bd3c2b7919bcea/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:50.156096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa66c90ff094739a15a781401254921, user_id=cb73a1fbe5d5479d83bd3c2b7919bcea, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:50.158781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:50.175219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1058/2118] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:50 2022] PUT /identity/v3/projects/dfa66c90ff094739a15a781401254921/users/cb73a1fbe5d5479d83bd3c2b7919bcea/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:50.187607 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:50.187896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:50.188167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:50.222812 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] MFA Rules not processed for user `cb73a1fbe5d5479d83bd3c2b7919bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:50.226270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:50.322308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1061/2119] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:50.335789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:50.337865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:50.418939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531beaa-b99a-40d8-b59b-1cc3a7288247 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:50.422953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beb79d-36ba-4527-8f75-ba5e2e7ddf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:50.423831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb79d-36ba-4527-8f75-ba5e2e7ddf4d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:50.426153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb79d-36ba-4527-8f75-ba5e2e7ddf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:50.426799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb79d-36ba-4527-8f75-ba5e2e7ddf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:50.437888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb79d-36ba-4527-8f75-ba5e2e7ddf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:50.439855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb79d-36ba-4527-8f75-ba5e2e7ddf4d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:50.452299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1059/2120] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:51.552279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:51.554064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:51.659962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a5e4a-5138-4a44-82b4-57d3cfe719d3 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:51.665185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:51.665826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:51.666109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:51.666386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] PATH_INFO: `/v3/users/821a1c2492294cf8a8d4f9dcf20f8860` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:51.667574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821a1c2492294cf8a8d4f9dcf20f8860)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:51.669534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:51.734523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821a1c2492294cf8a8d4f9dcf20f8860'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:51.752920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821a1c2492294cf8a8d4f9dcf20f8860'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:51.762905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821a1c2492294cf8a8d4f9dcf20f8860'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:51.763909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821a1c2492294cf8a8d4f9dcf20f8860'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:51.773727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821a1c2492294cf8a8d4f9dcf20f8860'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:51.783022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1062/2121] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:27:51 2022] DELETE /identity/v3/users/821a1c2492294cf8a8d4f9dcf20f8860 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:52.039399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e42fd3-15f4-48fa-ac41-5bf4e8e2e78d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.039920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e42fd3-15f4-48fa-ac41-5bf4e8e2e78d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.040008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e42fd3-15f4-48fa-ac41-5bf4e8e2e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.059238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-51e42fd3-15f4-48fa-ac41-5bf4e8e2e78d None None] MFA Rules not processed for user `cb73a1fbe5d5479d83bd3c2b7919bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:52.060479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51e42fd3-15f4-48fa-ac41-5bf4e8e2e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:52.126379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1060/2122] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:52.235245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.237975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:52.255646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:52.339407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303981a-ab9e-4a01-9aaa-191ab10f56c6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.344974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.346116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.346116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.346116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] PATH_INFO: `/v3/projects/2e1ab3e8029e4d419796787c256ac59e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.347576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1ab3e8029e4d419796787c256ac59e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:52.349429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:52.414427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1ab3e8029e4d419796787c256ac59e', 'request_id': 'req-58bff963-8486-4f53-bebd-4c60e135f397'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:52.439091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1ab3e8029e4d419796787c256ac59e', 'request_id': 'req-58bff963-8486-4f53-bebd-4c60e135f397'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:52.448469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1ab3e8029e4d419796787c256ac59e', 'request_id': 'req-58bff963-8486-4f53-bebd-4c60e135f397'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:52.466423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] The token cache is being invalidate because project 2e1ab3e8029e4d419796787c256ac59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:27:52.466660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:52.467550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-58bff963-8486-4f53-bebd-4c60e135f397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:27:52.469476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1063/2123] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:27:52 2022] DELETE /identity/v3/projects/2e1ab3e8029e4d419796787c256ac59e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:52.475062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.475356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.475639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.499267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:52.500553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:52.506495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:52.576676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1061/2124] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:52.586543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.587091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.587196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.608487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:52.609638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:52.618887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1064/2125] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:52.623489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.641297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcf2e9-c101-4431-861a-d6605b423b57 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.650153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.650842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.651188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.651522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.652229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:27:52.652693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:52.654512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:52.668770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1062/2126] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:27:52.677946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.691237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18ab2-784e-4c04-acdb-442647c76194 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.697239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.697857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.698185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.698402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.699085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:52.701090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:52.768276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1065/2127] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:27:52 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:52.771236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.782295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885df51-254d-429c-b982-257330e7fb74 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.853527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.854262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.854464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.854682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.855327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:52.857328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:52.885060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1063/2128] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:27:52 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:27:52.889082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.900718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548900a-5cc8-4bd9-bf0f-fae118b0c678 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.906248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.913713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.914089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.914547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.915245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:52.917047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:52.931388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1066/2129] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:52.935682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.946478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d13c2-ab1f-4914-876d-02cc955d47a4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.952074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbca2d-69e7-49ab-b02e-604019fd89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.952731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbca2d-69e7-49ab-b02e-604019fd89df admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.953012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbca2d-69e7-49ab-b02e-604019fd89df admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.953287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbca2d-69e7-49ab-b02e-604019fd89df admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:52.954169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbca2d-69e7-49ab-b02e-604019fd89df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:52.956081 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbca2d-69e7-49ab-b02e-604019fd89df admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:52.972328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1064/2130] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:27:52.976673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:52.991950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed84cb0-b010-43ea-945a-6880af4e8104 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:52.997309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:52.998200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:52.998568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:52.998959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] PATH_INFO: `/v3/projects/b2a788df85eb4ab7aa07282dab1f5b4b/users/753c77f1591342c9936f104b2c7833fc/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:53.015040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a788df85eb4ab7aa07282dab1f5b4b, user_id=753c77f1591342c9936f104b2c7833fc, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:53.017915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:53.033043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1067/2131] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:27:52 2022] PUT /identity/v3/projects/b2a788df85eb4ab7aa07282dab1f5b4b/users/753c77f1591342c9936f104b2c7833fc/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:27:53.039098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86730a90-d7f0-4a40-bf4c-d10be2e50311 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:53.039807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86730a90-d7f0-4a40-bf4c-d10be2e50311 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:53.039807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86730a90-d7f0-4a40-bf4c-d10be2e50311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:53.059707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-86730a90-d7f0-4a40-bf4c-d10be2e50311 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:53.060946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-86730a90-d7f0-4a40-bf4c-d10be2e50311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:53.124333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1065/2132] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:53.134744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:53.136604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:53.175630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:53.202647 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007f64a-f656-4ac3-b00d-555170ea3b2a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:53.206344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:53.206952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:53.207233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:53.207507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:53.217201 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:53.218652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:53.228711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1068/2133] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:00.146055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57aec5-ad06-4362-8b3f-057358b281e2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:00.146641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57aec5-ad06-4362-8b3f-057358b281e2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:00.146804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57aec5-ad06-4362-8b3f-057358b281e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:00.179498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2a57aec5-ad06-4362-8b3f-057358b281e2 None None] MFA Rules not processed for user `753c77f1591342c9936f104b2c7833fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:00.181242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2a57aec5-ad06-4362-8b3f-057358b281e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:00.185893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:00.328550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1066/2134] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:00.344415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:00.346177 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:00.491541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf910b6-5d0b-4d5d-bec3-085b7a63c6de service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:00.497935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:00.498648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:00.499053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:00.499761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:00.509508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:00.511732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:00.525600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1069/2135] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:02.059667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c40b2-746d-457d-a375-c7d0d7585f93 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:02.060453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c40b2-746d-457d-a375-c7d0d7585f93 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:02.066596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c40b2-746d-457d-a375-c7d0d7585f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:02.092000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c59c40b2-746d-457d-a375-c7d0d7585f93 None None] MFA Rules not processed for user `753c77f1591342c9936f104b2c7833fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:02.093300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c59c40b2-746d-457d-a375-c7d0d7585f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:02.105420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1067/2136] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:09.877328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:09.878766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:09.936010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54263e-7e95-4f72-9ec4-8547bef5a4a4 service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:09.939557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:09.940160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:09.940469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:09.940743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:09.943032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:10.005020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:10.006481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:10.016143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1070/2137] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:12.088570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=28 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:20.011706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:21.007137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94830a-ddf7-40ba-81b9-064806d59212 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:21.009605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94830a-ddf7-40ba-81b9-064806d59212 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:21.010095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94830a-ddf7-40ba-81b9-064806d59212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:21.032442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2b94830a-ddf7-40ba-81b9-064806d59212 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:21.033654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2b94830a-ddf7-40ba-81b9-064806d59212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:21.099098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1068/2138] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:21.141303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:21.142763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:21.218799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838e0db-2c4c-4907-ac84-40d14578853d service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:21.224276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:21.224885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:21.225163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:21.225434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:21.233542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:21.235110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:21.243923 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1071/2139] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:28:21.788052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361190-d124-459d-a897-f02afe8c3b23 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:21.788052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361190-d124-459d-a897-f02afe8c3b23 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:21.788390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab361190-d124-459d-a897-f02afe8c3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:21.808717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ab361190-d124-459d-a897-f02afe8c3b23 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:21.809935 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ab361190-d124-459d-a897-f02afe8c3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:21.819136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1069/2140] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 17 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:21.832615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:21.843214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a824-df43-44c7-81b7-41cbb9521333 service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:21.848304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:21.848908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:21.849180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:21.849620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:21.857849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:21.859420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:21.868452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1072/2141] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:28:22.108976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cc70-f92c-4d15-ae79-bebfd3f6587b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:22.109411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cc70-f92c-4d15-ae79-bebfd3f6587b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:22.109571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cc70-f92c-4d15-ae79-bebfd3f6587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:22.129852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3154cc70-f92c-4d15-ae79-bebfd3f6587b None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:22.131071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3154cc70-f92c-4d15-ae79-bebfd3f6587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:22.138462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1070/2142] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:22.162191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:22.177883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578c38c-e131-4c49-a87f-902c6defe35d service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:22.183831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:22.184665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:22.196465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:22.196780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:22.206323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:22.208087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:22.218084 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1073/2143] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:28:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:28:22.589034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41812e-89ac-4749-aa0b-1ca79eab3a8d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:22.589349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41812e-89ac-4749-aa0b-1ca79eab3a8d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:22.589664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41812e-89ac-4749-aa0b-1ca79eab3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:22.608740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ee41812e-89ac-4749-aa0b-1ca79eab3a8d None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:22.609949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee41812e-89ac-4749-aa0b-1ca79eab3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:22.617918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1071/2144] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 17 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:22.631277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:22.642297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e138-84b3-4b9c-8beb-bc56c2a885f3 service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:22.647773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:22.648809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:22.649091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:22.649443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:22.659147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:22.661901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:22.670800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1074/2145] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:28:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:28:24.994225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:24.994725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:24.994820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.016067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:25.017334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:25.037489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1072/2146] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:25.084836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:25.086252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:25.102704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec689fc-fa15-4797-b361-2d71e5784d5f service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:25.108119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882986e-8326-4e64-9eee-f21fb0a48a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:25.108776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882986e-8326-4e64-9eee-f21fb0a48a65 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:25.109063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882986e-8326-4e64-9eee-f21fb0a48a65 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:25.109330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882986e-8326-4e64-9eee-f21fb0a48a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.118752 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882986e-8326-4e64-9eee-f21fb0a48a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:25.120455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882986e-8326-4e64-9eee-f21fb0a48a65 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:25.141253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1075/2147] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:25.214166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:25.215772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:25.230376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032b967-ba28-4abc-916d-64c39250ed2a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:25.235071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:25.235714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:25.235996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:25.236303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] PATH_INFO: `/v3/users/cb73a1fbe5d5479d83bd3c2b7919bcea` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.237453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb73a1fbe5d5479d83bd3c2b7919bcea)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:25.240198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:25.303014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb73a1fbe5d5479d83bd3c2b7919bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.311262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb73a1fbe5d5479d83bd3c2b7919bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.312072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb73a1fbe5d5479d83bd3c2b7919bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.312854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb73a1fbe5d5479d83bd3c2b7919bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.320678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb73a1fbe5d5479d83bd3c2b7919bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.339865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1073/2148] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:28:25 2022] DELETE /identity/v3/users/cb73a1fbe5d5479d83bd3c2b7919bcea => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:25.344551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:25.344836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:25.345107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.365163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:25.366474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:25.446108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1076/2149] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:25.456486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:25.458181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:25.560465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52888a75-89ce-41be-9174-48a91cf1ff9f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:25.564189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776bbc-2538-47fd-81fd-48aa028789f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:25.564806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776bbc-2538-47fd-81fd-48aa028789f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:25.565105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776bbc-2538-47fd-81fd-48aa028789f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:25.565379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776bbc-2538-47fd-81fd-48aa028789f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.572173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:25.577884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776bbc-2538-47fd-81fd-48aa028789f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:25.580085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776bbc-2538-47fd-81fd-48aa028789f2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:25.592181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1074/2150] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:25.799290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:25.801632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:25.823729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f8be-3cab-4a49-972f-dca3b049c26b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:25.828781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:25.829429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:25.829877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:25.830634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] PATH_INFO: `/v3/projects/dfa66c90ff094739a15a781401254921` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.833086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa66c90ff094739a15a781401254921)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:25.835444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:25.873104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:25.887986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa66c90ff094739a15a781401254921', 'request_id': 'req-2cabb01e-2913-4959-ae89-a718faebc523'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.896944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa66c90ff094739a15a781401254921', 'request_id': 'req-2cabb01e-2913-4959-ae89-a718faebc523'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.903588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa66c90ff094739a15a781401254921', 'request_id': 'req-2cabb01e-2913-4959-ae89-a718faebc523'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.916322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] The token cache is being invalidate because project dfa66c90ff094739a15a781401254921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:28:25.916546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.917221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2cabb01e-2913-4959-ae89-a718faebc523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:25.919266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1077/2151] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:28:25 2022] DELETE /identity/v3/projects/dfa66c90ff094739a15a781401254921 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:25.925048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:25.925413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:25.925722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:25.945877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:25.947092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:26.022918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1075/2152] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:26.030142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.030640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.030914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.059818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:26.061650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:26.072560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1078/2153] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:26.079320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.111289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e879b5-7410-447c-9aff-db0042ce762e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.120836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.121668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.121964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.122243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.122916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:28:26.123225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.124888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.151509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1076/2154] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:28:26.152686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.170061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4dd78-6c17-4ee9-8946-fe3fcd035fc4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.178279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.179236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.179665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.180302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.181474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.184106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.225506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1079/2155] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:28:26 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:28:26.229246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.242832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3595b-c73c-4e64-a0de-c88288f5ca9d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.317537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.318174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.318461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.318744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.319397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.323110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.353293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1077/2156] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:28:26 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:28:26.358186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.369181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07657bb-c804-4447-8f56-da2e05c5f704 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.374270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.375102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.375464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.375804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.376560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.378231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.390048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1080/2157] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:26.393918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.418717 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70c3e3-44cd-4fb8-84de-c0d1d6433054 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.431206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782aa5f-c95b-4d9b-88f4-a66a65b03df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.431974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782aa5f-c95b-4d9b-88f4-a66a65b03df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.432274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782aa5f-c95b-4d9b-88f4-a66a65b03df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.433145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782aa5f-c95b-4d9b-88f4-a66a65b03df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.433810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782aa5f-c95b-4d9b-88f4-a66a65b03df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.435410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782aa5f-c95b-4d9b-88f4-a66a65b03df0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.471320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1078/2158] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:26.475690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.487117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f287f0-15df-4a30-bf4a-32a19c99851d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.492381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.493308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.493426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.493670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] PATH_INFO: `/v3/projects/8e9ce2ede1cb461f933630409c52d8c2/users/aaeec711a15a45179b165e38402c9bd3/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.515535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9ce2ede1cb461f933630409c52d8c2, user_id=aaeec711a15a45179b165e38402c9bd3, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.518535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.538051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1081/2159] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:26 2022] PUT /identity/v3/projects/8e9ce2ede1cb461f933630409c52d8c2/users/aaeec711a15a45179b165e38402c9bd3/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:26.539948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c31b-ef40-4155-9459-b09f40534d69 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.540340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c31b-ef40-4155-9459-b09f40534d69 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.540673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c31b-ef40-4155-9459-b09f40534d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.564364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f645c31b-ef40-4155-9459-b09f40534d69 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:26.568487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f645c31b-ef40-4155-9459-b09f40534d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:26.626705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:26.636560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1079/2160] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:26.647746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:26.649743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:26.711252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fc8ee-c6de-48a3-9f89-188921fc89f4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:26.714858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:26.715466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:26.715776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:26.716050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:26.726853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:26.728313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:26.738612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1082/2161] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:29.065331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ac17-55a1-4a36-9792-2203f7cffa71 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:29.065883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ac17-55a1-4a36-9792-2203f7cffa71 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:29.065974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ac17-55a1-4a36-9792-2203f7cffa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:29.095596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7506ac17-55a1-4a36-9792-2203f7cffa71 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:29.096771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7506ac17-55a1-4a36-9792-2203f7cffa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:29.105937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1080/2162] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:29.133085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:29.135954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:29.219261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:29.240223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c89d-b0de-4d25-a97c-ad50112aa379 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:29.256949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:29.257440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:29.257724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:29.257993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:29.273326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:29.274939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:29.296772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1083/2163] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:32.212189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.212763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.212763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.253916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] MFA Rules not processed for user `aaeec711a15a45179b165e38402c9bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:32.255428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:32.323781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1081/2164] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:32.328299 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:32.338485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b34f4b-3a04-4528-9563-55f0461677c4 service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:32.343479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:32.344085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.344396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.344666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.345305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:32.347725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:32.376731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1084/2165] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:28:32 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:32.381018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:32.392147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75eec7-bf44-4f39-935b-eb177de82fe8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:32.453347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:32.453971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.454248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.454543 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.455167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:32.457982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:32.482269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1082/2166] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:28:32 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:32.486317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:32.497753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1865-a85e-4271-806f-40e8b48cd555 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:32.502656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:32.503618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.504040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.504485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.505151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:32.506773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:32.518172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1085/2167] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:28:32.523245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:32.535203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb6206-3dc9-4d7a-9889-d140ceaca746 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:32.539960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:32.540654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.540936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.541209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] PATH_INFO: `/v3/projects/b49dad7a7a964d0084adcdbfabb95671/users/9c3976f199c54a1598f146225c862890/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.559869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49dad7a7a964d0084adcdbfabb95671, user_id=9c3976f199c54a1598f146225c862890, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:32.562779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:32.577026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1083/2168] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:32 2022] PUT /identity/v3/projects/b49dad7a7a964d0084adcdbfabb95671/users/9c3976f199c54a1598f146225c862890/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:28:32.581085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:32.592178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d58c-af18-4af9-aefe-74aeb5361dd4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:32.650632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba4835-6b24-41d3-80aa-b78e906be994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:32.651239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4835-6b24-41d3-80aa-b78e906be994 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.651515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4835-6b24-41d3-80aa-b78e906be994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.652588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba4835-6b24-41d3-80aa-b78e906be994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.653295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba4835-6b24-41d3-80aa-b78e906be994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:32.654942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba4835-6b24-41d3-80aa-b78e906be994 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:32.667531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1086/2169] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:32.674858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:32.697681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32f94a-a177-4a58-a0a6-39bb5de67f2e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:32.703625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:32.706875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.706875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.706875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] PATH_INFO: `/v3/projects/b49dad7a7a964d0084adcdbfabb95671/users/9c3976f199c54a1598f146225c862890/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.707956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49dad7a7a964d0084adcdbfabb95671, user_id=9c3976f199c54a1598f146225c862890, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:32.711956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:32.726976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1084/2170] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:32 2022] PUT /identity/v3/projects/b49dad7a7a964d0084adcdbfabb95671/users/9c3976f199c54a1598f146225c862890/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:33.470245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed20d7-fd2d-46a6-9d9c-c5dd5b77e226 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:33.471363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed20d7-fd2d-46a6-9d9c-c5dd5b77e226 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:33.471592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed20d7-fd2d-46a6-9d9c-c5dd5b77e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:33.500082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6bed20d7-fd2d-46a6-9d9c-c5dd5b77e226 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:33.501453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6bed20d7-fd2d-46a6-9d9c-c5dd5b77e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:33.593240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1087/2171] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:33.617241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:33.619434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:33.704623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:33.799260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ffbf-a69d-498c-9769-1e87d83b7f04 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:33.806509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:33.807684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:33.808323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:33.808794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:33.819747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:33.821833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:33.835389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1085/2172] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:37.681608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:37.682147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:37.682147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:37.717986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:37.719989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:37.733401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1088/2173] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:37.755958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:37.767861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bba90-45d2-4f11-8496-7bbfd458fd99 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:37.774863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d356-b641-48a8-a3dc-734ca0516153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:37.775672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d356-b641-48a8-a3dc-734ca0516153 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:37.776112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d356-b641-48a8-a3dc-734ca0516153 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:37.776758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d356-b641-48a8-a3dc-734ca0516153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:37.788651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4d356-b641-48a8-a3dc-734ca0516153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:37.790442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4d356-b641-48a8-a3dc-734ca0516153 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:37.802343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1086/2174] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:38.404382 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:38.406211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:38.424053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174519f1-ebf6-4af8-bab0-a5d370d0fe71 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:38.433054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:38.433872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:38.434229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:38.434582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] PATH_INFO: `/v3/users/25a3150713c2445aab942b4bb0d99e1f` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:38.435924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a3150713c2445aab942b4bb0d99e1f)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:38.439076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:38.483764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:38.495611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a3150713c2445aab942b4bb0d99e1f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:38.531329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a3150713c2445aab942b4bb0d99e1f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:38.540774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a3150713c2445aab942b4bb0d99e1f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:38.541667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a3150713c2445aab942b4bb0d99e1f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:38.572577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a3150713c2445aab942b4bb0d99e1f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:38.580421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1089/2175] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:28:38 2022] DELETE /identity/v3/users/25a3150713c2445aab942b4bb0d99e1f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:38.611374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:38.612006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:38.613410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:38.681123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] MFA Rules not processed for user `9c3976f199c54a1598f146225c862890`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:38.682351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:38.820444 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1087/2176] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:38.827947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:38.829478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:38.883599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:38.885393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:38.946642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa581e-3894-4b0f-8a45-3d4bc0c7e42a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:38.950893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:38.951635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:38.951977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:38.952344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:38.954154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:38.992909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb107-1170-4f83-8e14-83b1d2a2c5db None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:38.999066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:38.999831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.000190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.000674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] PATH_INFO: `/v3/projects/dcfaadb0209f46fdb25607c72edc22af` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:39.002102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfaadb0209f46fdb25607c72edc22af)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:39.004417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:39.047830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:39.049602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:39.060386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1090/2177] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:39.062380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:39.074486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfaadb0209f46fdb25607c72edc22af', 'request_id': 'req-8b0e3150-7677-4841-8481-eea4cc6b8bcb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.082514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfaadb0209f46fdb25607c72edc22af', 'request_id': 'req-8b0e3150-7677-4841-8481-eea4cc6b8bcb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.090771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfaadb0209f46fdb25607c72edc22af', 'request_id': 'req-8b0e3150-7677-4841-8481-eea4cc6b8bcb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.109965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] The token cache is being invalidate because project dcfaadb0209f46fdb25607c72edc22af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:28:39.110367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.111147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8b0e3150-7677-4841-8481-eea4cc6b8bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.113844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1088/2178] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:28:38 2022] DELETE /identity/v3/projects/dcfaadb0209f46fdb25607c72edc22af => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:39.118158 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:39.130839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86131b-9be0-4744-b6bd-fa4b4839ca5a service glance] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:39.198504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:39.217111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:39.218605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.218890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.219169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] PATH_INFO: `/v3/users/957715fdd354424c93bbc689ab164a0c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:39.220641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957715fdd354424c93bbc689ab164a0c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:39.233801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:39.242340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.242727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.243069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:39.272925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:39.275264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:39.311901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957715fdd354424c93bbc689ab164a0c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.329875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957715fdd354424c93bbc689ab164a0c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.340861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957715fdd354424c93bbc689ab164a0c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.341505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957715fdd354424c93bbc689ab164a0c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.349903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957715fdd354424c93bbc689ab164a0c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.353821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1089/2179] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:39.359192 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1091/2180] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:28:39 2022] DELETE /identity/v3/users/957715fdd354424c93bbc689ab164a0c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:39.368222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:39.369723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:39.459339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672370e5-52d1-4ef2-bbf9-81b9a9ca7799 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:39.531917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:39.532647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.532948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.533225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:39.535352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:39.546776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:39.572194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:39.573698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:39.633622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:39.635878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959c941-76ab-41dc-852a-d346467e99d5 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:39.646364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1090/2181] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:28:39.666733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31d79f-72c7-45ae-931c-5b92a4fdaca7 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:39.672522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:39.673182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.673465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.673736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] PATH_INFO: `/v3/projects/28a4ba2803054b8faf530a63313d5b05` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:39.675430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a4ba2803054b8faf530a63313d5b05)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:39.676955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:39.757731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a4ba2803054b8faf530a63313d5b05', 'request_id': 'req-d8594115-abe7-40d6-b60c-3c2f2ef782d5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.767902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a4ba2803054b8faf530a63313d5b05', 'request_id': 'req-d8594115-abe7-40d6-b60c-3c2f2ef782d5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.779287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a4ba2803054b8faf530a63313d5b05', 'request_id': 'req-d8594115-abe7-40d6-b60c-3c2f2ef782d5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.788075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:39.795614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] The token cache is being invalidate because project 28a4ba2803054b8faf530a63313d5b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:28:39.796669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.797155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d8594115-abe7-40d6-b60c-3c2f2ef782d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:39.800705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1092/2182] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:28:39 2022] DELETE /identity/v3/projects/28a4ba2803054b8faf530a63313d5b05 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:28:39.804140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.805614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.805905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:39.851801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:39.853104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:39.953992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1091/2183] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:39.963448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:39.963891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:39.963985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.005784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:40.007991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:40.044673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1093/2184] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:40.051688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.064418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a8d3-604f-4c73-9a93-5217b7cdaa6a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.071118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.071680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.071956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.072229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.072933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:28:40.073232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.074818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.091834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1092/2185] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:28:40.096238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.109059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f87dbc-7627-4cf7-a619-818b54789820 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.115115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.115887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.116181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.116474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.117120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.119025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.159155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1094/2186] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:28:40 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:40.159472 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.172348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e01ca-f332-4e2c-b51a-31001e620582 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.250951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.251913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.252534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.253263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.254236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.256162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.281077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1093/2187] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:28:40 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:40.285111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.299056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55fec-818a-46f5-ae0d-8407f0fc837d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.308610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.309438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.309830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.310191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.310950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.313322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.332361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1095/2188] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:40.336000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.347339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94deb590-de6a-4f19-88b1-314d0ac78c94 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.352530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb97e5-96a4-466a-a79d-078d9dc3e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.353139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb97e5-96a4-466a-a79d-078d9dc3e9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.353421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb97e5-96a4-466a-a79d-078d9dc3e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.353833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb97e5-96a4-466a-a79d-078d9dc3e9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.354491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb97e5-96a4-466a-a79d-078d9dc3e9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.356096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb97e5-96a4-466a-a79d-078d9dc3e9c6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.368348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1094/2189] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:40.372470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.396114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7967d4-25d9-405b-b101-687946625616 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.407887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.410926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.412884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.413347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] PATH_INFO: `/v3/projects/1eaef67b826b45e68427cc86eaad3f30/users/1202c50a5c7f492db0587f614b7d0e5a/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.434984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaef67b826b45e68427cc86eaad3f30, user_id=1202c50a5c7f492db0587f614b7d0e5a, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.440266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.475455 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1096/2190] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:40 2022] PUT /identity/v3/projects/1eaef67b826b45e68427cc86eaad3f30/users/1202c50a5c7f492db0587f614b7d0e5a/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:28:40.486248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.486649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.486903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.531496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] MFA Rules not processed for user `1202c50a5c7f492db0587f614b7d0e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:40.533332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:40.546668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:40.626856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1095/2191] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:40.632147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.716910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3186a64-3027-4aa4-af2c-628b1a7dc7df admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.739197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.739827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.740105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.740416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.741072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.742982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.788924 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1097/2192] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:28:40 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:28:40.792898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.809320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518591e6-e67e-4326-8ae6-bf5fbcd081e8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.880031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.880729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.880914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.881132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.881763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.883678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.916431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1096/2193] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:28:40 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:40.920738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.935939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be907-e86d-4c94-81f0-748aab77f2db admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.943589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.944352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.944793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.945221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.946002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.947699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:40.965404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1098/2194] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:40.966167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:40.980139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bce536-442f-456c-a4ca-6837a3f7c35f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:40.986808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82509cc-a99f-4c77-a79c-576939ddb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:40.988588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82509cc-a99f-4c77-a79c-576939ddb061 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:40.988931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82509cc-a99f-4c77-a79c-576939ddb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:40.989481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82509cc-a99f-4c77-a79c-576939ddb061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:40.989989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82509cc-a99f-4c77-a79c-576939ddb061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:40.991746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82509cc-a99f-4c77-a79c-576939ddb061 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.012867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1097/2195] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:28:41.014355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.030448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec975fc-6cc1-43f2-b927-38430d6bcb4b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.043716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.044800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.046215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.046598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] PATH_INFO: `/v3/projects/ef74d2288b9c49069c4c6ed64502a2d6/users/7871c6a79846492db80524adbf2c1405/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.082668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef74d2288b9c49069c4c6ed64502a2d6, user_id=7871c6a79846492db80524adbf2c1405, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.086235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.111884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1099/2196] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:41 2022] PUT /identity/v3/projects/ef74d2288b9c49069c4c6ed64502a2d6/users/7871c6a79846492db80524adbf2c1405/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:41.125933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.126218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.126707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.171184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] MFA Rules not processed for user `7871c6a79846492db80524adbf2c1405`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:41.172622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:41.324435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1098/2197] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:28:41.326627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.407503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:41.427053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e2297-4de9-4610-b753-e4f07839bbbf admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.432519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.433137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.433419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.433766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.436611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.438574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.475998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1100/2198] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:28:41 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:41.481132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.496857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5e3e5-ebe5-49d2-ab43-3329b0f2c803 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.514040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:41.631558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.633460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.633751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.635777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.636610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.640636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.675916 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1099/2199] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:28:41 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:41.679892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.693381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668071-eca3-458c-84b4-3522bb6c637c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.703252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.703876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.704166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.704469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.705122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.708075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.724351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1101/2200] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:41.727751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.739963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e847-5678-4ae2-832d-b0135a651df1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.749525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.750975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.751268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.752149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] PATH_INFO: `/v3/projects/77d8de249c7d4442aaa5d4745e7e89b6/users/be422419690348169282d1f7bbbc1ee0/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.770055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d8de249c7d4442aaa5d4745e7e89b6, user_id=be422419690348169282d1f7bbbc1ee0, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.773973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.795978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1100/2201] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:41 2022] PUT /identity/v3/projects/77d8de249c7d4442aaa5d4745e7e89b6/users/be422419690348169282d1f7bbbc1ee0/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:41.799684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.810788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8311d-7355-43f5-badf-be15b069de7a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.892059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfe852-c14d-4a73-adda-502d8d688b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.892824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe852-c14d-4a73-adda-502d8d688b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.893172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe852-c14d-4a73-adda-502d8d688b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.893507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfe852-c14d-4a73-adda-502d8d688b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.894771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfe852-c14d-4a73-adda-502d8d688b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.896463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfe852-c14d-4a73-adda-502d8d688b8f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.918747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1102/2202] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:41.922807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:41.935571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c775d7-c489-42a7-9ee6-da6fd471154f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:41.941228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:41.942277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.942574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.942844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] PATH_INFO: `/v3/projects/77d8de249c7d4442aaa5d4745e7e89b6/users/be422419690348169282d1f7bbbc1ee0/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:41.944858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d8de249c7d4442aaa5d4745e7e89b6, user_id=be422419690348169282d1f7bbbc1ee0, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:41.947707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:41.974597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1101/2203] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:41 2022] PUT /identity/v3/projects/77d8de249c7d4442aaa5d4745e7e89b6/users/be422419690348169282d1f7bbbc1ee0/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:41.976495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e58f5-28b0-4811-bfa9-caff60c43893 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:41.983532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e58f5-28b0-4811-bfa9-caff60c43893 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:41.984036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e58f5-28b0-4811-bfa9-caff60c43893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:42.026673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-879e58f5-28b0-4811-bfa9-caff60c43893 None None] MFA Rules not processed for user `be422419690348169282d1f7bbbc1ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:42.028593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-879e58f5-28b0-4811-bfa9-caff60c43893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:42.129712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1103/2204] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:42.154030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:42.156442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:42.268423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0ee6-84ba-4e20-8968-4a01d60f8db4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:42.277254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:42.278037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:42.278422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:42.278861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:42.361983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:42.365225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:42.380296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1102/2205] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:44.039332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:44.039859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:44.039949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:44.082211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:44.084739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:44.120062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:44.131135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:44.134302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d055e1-99a6-4cc3-b934-ffcca17b9ddd service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:44.144764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:44.145390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:44.145671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:44.145940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:44.176814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1104/2206] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:44.181610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:44.199044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:44.201509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:44.235598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:44.238362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:44.254496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1103/2207] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:28:44.369636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef99247-8122-4c30-a9f6-f5a2a153e081 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:44.382500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae669ff-115b-401c-b97e-8ab1aebcbb31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:44.382766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae669ff-115b-401c-b97e-8ab1aebcbb31 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:44.383046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae669ff-115b-401c-b97e-8ab1aebcbb31 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:44.383463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae669ff-115b-401c-b97e-8ab1aebcbb31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:44.393265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae669ff-115b-401c-b97e-8ab1aebcbb31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:44.395855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae669ff-115b-401c-b97e-8ab1aebcbb31 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:44.430488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1105/2208] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:28:45.272136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:45.286064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff741d-3b01-4d79-b740-36938fdd29e6 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:45.302005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:45.302941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:45.303399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:45.303845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:45.324437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:45.329400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:45.364168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1104/2209] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:48.325966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:48.326520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:48.326629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:48.367239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:48.368821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:48.387083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1106/2210] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:48.412282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:48.413938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:48.434542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d3e9a-2097-4dac-ba90-c22ed0023661 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:48.450451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d787a-5bb5-418f-9683-31a43f2e73cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:48.451091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d787a-5bb5-418f-9683-31a43f2e73cc service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:48.451378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d787a-5bb5-418f-9683-31a43f2e73cc service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:48.451655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d787a-5bb5-418f-9683-31a43f2e73cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:48.467474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d787a-5bb5-418f-9683-31a43f2e73cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:48.477009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d787a-5bb5-418f-9683-31a43f2e73cc service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:48.493553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1105/2211] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:49.614246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:49.624741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775ac6a-0f33-4089-aa7c-b4879333dd3a None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:49.630235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:49.631125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:49.631587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:49.632026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] PATH_INFO: `/v3/users/1202c50a5c7f492db0587f614b7d0e5a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:49.633553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1202c50a5c7f492db0587f614b7d0e5a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:49.636433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:49.698707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1202c50a5c7f492db0587f614b7d0e5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:49.712021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1202c50a5c7f492db0587f614b7d0e5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:49.752147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1202c50a5c7f492db0587f614b7d0e5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:49.753832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1202c50a5c7f492db0587f614b7d0e5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:49.767868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1202c50a5c7f492db0587f614b7d0e5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:49.774292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1107/2212] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:28:49 2022] DELETE /identity/v3/users/1202c50a5c7f492db0587f614b7d0e5a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:28:49.779042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:49.779545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:49.779637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:49.799371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:49.801283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:49.893180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1106/2213] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:49.904032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:49.905602 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:49.946510 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:49.982826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25660-b9d4-4edc-bf00-b33ccdd7d517 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:49.986916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69def9b2-bc2f-4dd7-a6a3-d663b8f67b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:49.988333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69def9b2-bc2f-4dd7-a6a3-d663b8f67b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:49.988698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69def9b2-bc2f-4dd7-a6a3-d663b8f67b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:49.989045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69def9b2-bc2f-4dd7-a6a3-d663b8f67b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:50.004603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69def9b2-bc2f-4dd7-a6a3-d663b8f67b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:50.006297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69def9b2-bc2f-4dd7-a6a3-d663b8f67b6d service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:50.018524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1108/2214] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:50.327689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:50.329276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:50.349485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4359-31d4-4209-baa6-baf5ced61037 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:50.357672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:50.359078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:50.360264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:50.363234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] PATH_INFO: `/v3/projects/1eaef67b826b45e68427cc86eaad3f30` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:50.364547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaef67b826b45e68427cc86eaad3f30)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:50.366731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:50.428679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaef67b826b45e68427cc86eaad3f30', 'request_id': 'req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.434997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaef67b826b45e68427cc86eaad3f30', 'request_id': 'req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.442489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaef67b826b45e68427cc86eaad3f30', 'request_id': 'req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.461679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] The token cache is being invalidate because project 1eaef67b826b45e68427cc86eaad3f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:28:50.462258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.463045 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.463365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:50.463813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:50.464116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:50.467854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1107/2215] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:28:50 2022] DELETE /identity/v3/projects/1eaef67b826b45e68427cc86eaad3f30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:50.469592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:50.471292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:50.489215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] MFA Rules not processed for user `aaeec711a15a45179b165e38402c9bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:50.490597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:50.496757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:50.551959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13bc2-c9b8-42e3-9dbe-d635c2c816a8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:50.560430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1109/2216] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:50.560574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:50.560574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:50.560574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:50.560574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] PATH_INFO: `/v3/users/7871c6a79846492db80524adbf2c1405` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:50.560980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7871c6a79846492db80524adbf2c1405)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:50.561321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:50.619155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7871c6a79846492db80524adbf2c1405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.630124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7871c6a79846492db80524adbf2c1405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.630973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7871c6a79846492db80524adbf2c1405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.631616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7871c6a79846492db80524adbf2c1405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.639493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7871c6a79846492db80524adbf2c1405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:50.663564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1108/2217] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:28:50 2022] DELETE /identity/v3/users/7871c6a79846492db80524adbf2c1405 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:50.950700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:50.969751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b2b4-9c20-4b7a-b7c4-4e084e856d67 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:51.041681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:51.042328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:51.042610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:51.042886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] PATH_INFO: `/v3/projects/ef74d2288b9c49069c4c6ed64502a2d6` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:51.044007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef74d2288b9c49069c4c6ed64502a2d6)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:51.046015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:51.098823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef74d2288b9c49069c4c6ed64502a2d6', 'request_id': 'req-140cbf46-e568-4e3c-aec5-56f112895c5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.110976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef74d2288b9c49069c4c6ed64502a2d6', 'request_id': 'req-140cbf46-e568-4e3c-aec5-56f112895c5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.121073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef74d2288b9c49069c4c6ed64502a2d6', 'request_id': 'req-140cbf46-e568-4e3c-aec5-56f112895c5a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.142657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] The token cache is being invalidate because project ef74d2288b9c49069c4c6ed64502a2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:28:51.143096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.144588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.146643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1110/2218] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:28:50 2022] DELETE /identity/v3/projects/ef74d2288b9c49069c4c6ed64502a2d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:51.150596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:51.152116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:51.178572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f6e9-0732-4c9b-8da3-6ca749866014 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:51.242398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:51.243361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:51.243477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:51.243699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] PATH_INFO: `/v3/users/be422419690348169282d1f7bbbc1ee0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:51.244848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be422419690348169282d1f7bbbc1ee0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:51.246930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:51.290123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:51.297471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be422419690348169282d1f7bbbc1ee0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.306161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be422419690348169282d1f7bbbc1ee0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.306810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be422419690348169282d1f7bbbc1ee0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.307429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be422419690348169282d1f7bbbc1ee0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.314654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d833837-78bd-41b2-83e8-f41db550eb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be422419690348169282d1f7bbbc1ee0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.333465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1109/2219] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:28:51 2022] DELETE /identity/v3/users/be422419690348169282d1f7bbbc1ee0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:28:51.627522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:51.629608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:51.644630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cbf46-e568-4e3c-aec5-56f112895c5a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:51.655785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:51.720159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:51.720855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:51.721133 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:51.721436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] PATH_INFO: `/v3/projects/77d8de249c7d4442aaa5d4745e7e89b6` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:51.722728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d8de249c7d4442aaa5d4745e7e89b6)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:51.724791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:51.774952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d8de249c7d4442aaa5d4745e7e89b6', 'request_id': 'req-cad31358-b0e8-4502-b616-36923eda6374'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.783027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d8de249c7d4442aaa5d4745e7e89b6', 'request_id': 'req-cad31358-b0e8-4502-b616-36923eda6374'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.789154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d8de249c7d4442aaa5d4745e7e89b6', 'request_id': 'req-cad31358-b0e8-4502-b616-36923eda6374'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.800775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] The token cache is being invalidate because project 77d8de249c7d4442aaa5d4745e7e89b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:28:51.801337 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.802160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-cad31358-b0e8-4502-b616-36923eda6374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:28:51.803672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1111/2220] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:28:51 2022] DELETE /identity/v3/projects/77d8de249c7d4442aaa5d4745e7e89b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:51.808674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:51.809043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:51.809384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:51.829768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:51.831673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:51.895934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1110/2221] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:51.904215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799978b-9684-4746-9951-e2f19c752091 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:51.904638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799978b-9684-4746-9951-e2f19c752091 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:51.904918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799978b-9684-4746-9951-e2f19c752091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:51.926905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c799978b-9684-4746-9951-e2f19c752091 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:51.928123 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c799978b-9684-4746-9951-e2f19c752091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:51.937492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1112/2222] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:51.943541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:51.953664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c132550-bba8-46fb-8a1a-0a8adaebce90 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:51.960982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:51.961629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:51.961907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:51.962179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:51.963014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:28:51.963323 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:51.965379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:51.985664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1111/2223] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:28:51.990006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799978b-9684-4746-9951-e2f19c752091 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:52.000305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799978b-9684-4746-9951-e2f19c752091 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:52.013132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:52.014070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.014352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.015119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.015776 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:52.020683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:52.053430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1113/2224] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:28:51 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:52.054645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:52.065937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3bc33-1601-441c-a9a7-09bca13889c9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:52.126350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:52.126951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.127232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.127505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.128864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:52.130808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:52.151168 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1112/2225] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:28:52 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:28:52.155469 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:52.166214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dc770-21f9-4669-9b16-f5445a08db3f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:52.170842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:52.171443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.171721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.171993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.172674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:52.174253 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:52.185780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1114/2226] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:52.189862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:52.200705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed45a0-71eb-4087-b1b6-742da92da35d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:52.205263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14dc92-1e62-4c1e-af9c-4bfe66caa690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:52.205855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14dc92-1e62-4c1e-af9c-4bfe66caa690 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.206134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14dc92-1e62-4c1e-af9c-4bfe66caa690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.206556 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14dc92-1e62-4c1e-af9c-4bfe66caa690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.207193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14dc92-1e62-4c1e-af9c-4bfe66caa690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:52.208787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14dc92-1e62-4c1e-af9c-4bfe66caa690 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:52.219703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1113/2227] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:28:52.223952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:52.234335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251f3f9-6cf3-44d2-8d1c-34fe5abc09c6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:52.239931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:52.240982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.240982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.241176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] PATH_INFO: `/v3/projects/48be0a04a7dd47eeb5e6484985826710/users/d59c9584c30649b291c4fa44771303c6/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.258184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48be0a04a7dd47eeb5e6484985826710, user_id=d59c9584c30649b291c4fa44771303c6, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:52.261029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:52.287848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1115/2228] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:28:52 2022] PUT /identity/v3/projects/48be0a04a7dd47eeb5e6484985826710/users/d59c9584c30649b291c4fa44771303c6/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:28:52.308287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c592f-7c99-4300-8b5d-6fb5b12ceef1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.308812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c592f-7c99-4300-8b5d-6fb5b12ceef1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.321008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c592f-7c99-4300-8b5d-6fb5b12ceef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.382503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0c5c592f-7c99-4300-8b5d-6fb5b12ceef1 None None] MFA Rules not processed for user `d59c9584c30649b291c4fa44771303c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:52.384392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0c5c592f-7c99-4300-8b5d-6fb5b12ceef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:52.393494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:52.451821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1114/2229] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:52.463859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:52.465568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:52.506822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:52.524927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06811734-e93b-4195-8799-713a550d3478 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:52.528513 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:52.529120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:52.529401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:52.529676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:52.538519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:52.539944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:52.548843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1116/2230] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:53.834697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560e6c-d8b9-4fd7-81ae-6d148e8bf72d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:53.835190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560e6c-d8b9-4fd7-81ae-6d148e8bf72d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:53.835334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560e6c-d8b9-4fd7-81ae-6d148e8bf72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:53.860578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-35560e6c-d8b9-4fd7-81ae-6d148e8bf72d None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:53.862037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-35560e6c-d8b9-4fd7-81ae-6d148e8bf72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:53.929569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1115/2231] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:53.950764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:53.953066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:54.052600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bbe4f-bdde-40e7-8922-8b87ab04cc2a service glance] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:54.058895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:54.059685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:54.060106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:54.060519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:54.070689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:54.072545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:54.083401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1117/2232] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:28:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:28:55.385130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19588a-102c-4dda-a2c5-1ba9d4b6584d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:55.386189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19588a-102c-4dda-a2c5-1ba9d4b6584d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:55.386693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19588a-102c-4dda-a2c5-1ba9d4b6584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:55.409763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ea19588a-102c-4dda-a2c5-1ba9d4b6584d None None] MFA Rules not processed for user `95df35149a7842c2b8908aeb56516d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:55.411544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ea19588a-102c-4dda-a2c5-1ba9d4b6584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:55.486007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1116/2233] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:04.084886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=42 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:05.473028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=72 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:31.634747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:31.725079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ed9fc-f2ce-4f66-a411-09c1a1e825f0 service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:31.729790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:31.730419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:31.730772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:31.731046 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] PATH_INFO: `/v3/users/d59c9584c30649b291c4fa44771303c6` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:31.732163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59c9584c30649b291c4fa44771303c6)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:31.734118 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:31.781514 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59c9584c30649b291c4fa44771303c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:31.794376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59c9584c30649b291c4fa44771303c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:31.803087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59c9584c30649b291c4fa44771303c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:31.803805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59c9584c30649b291c4fa44771303c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:31.811662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59c9584c30649b291c4fa44771303c6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:31.818644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1118/2234] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:29:31 2022] DELETE /identity/v3/users/d59c9584c30649b291c4fa44771303c6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:29:31.822766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:31.823241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:31.823338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:31.842558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:31.844041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:31.904127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1117/2235] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:31.914707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:31.916266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:31.981615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ba6e-766a-482e-bcfa-14897bcfbc52 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:31.981615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fc318-a290-4e2f-bad6-fef884ad1717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:31.981615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc318-a290-4e2f-bad6-fef884ad1717 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:31.981615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc318-a290-4e2f-bad6-fef884ad1717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:31.982080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc318-a290-4e2f-bad6-fef884ad1717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:31.992271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fc318-a290-4e2f-bad6-fef884ad1717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:31.993702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fc318-a290-4e2f-bad6-fef884ad1717 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:32.003851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1119/2236] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:32.426575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:32.428422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:32.451609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ae6d-815a-46c1-9c62-83064b8436d2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:32.457499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:32.458213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:32.458494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:32.458773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] PATH_INFO: `/v3/projects/48be0a04a7dd47eeb5e6484985826710` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:32.470592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48be0a04a7dd47eeb5e6484985826710)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:32.473149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:32.523563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48be0a04a7dd47eeb5e6484985826710', 'request_id': 'req-ef2b0751-3257-4370-b9d3-8b97aba3f839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:32.529863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48be0a04a7dd47eeb5e6484985826710', 'request_id': 'req-ef2b0751-3257-4370-b9d3-8b97aba3f839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:32.536209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48be0a04a7dd47eeb5e6484985826710', 'request_id': 'req-ef2b0751-3257-4370-b9d3-8b97aba3f839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:32.549147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] The token cache is being invalidate because project 48be0a04a7dd47eeb5e6484985826710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:29:32.549507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:32.550420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ef2b0751-3257-4370-b9d3-8b97aba3f839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:29:32.551913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1118/2237] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:29:32 2022] DELETE /identity/v3/projects/48be0a04a7dd47eeb5e6484985826710 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:29:32.556862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:32.557146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:32.557418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:32.576199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:32.577409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:32.597290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:32.656092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1120/2238] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:32.664612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:32.664903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:32.665183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:32.686747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:32.688028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:32.702901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1119/2239] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:32.705228 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:32.730562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81b6e3-8b94-4b02-aff0-d4df3e8e69fe None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:32.742279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:32.742915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:32.743194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:32.743464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:32.747328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:29:32.748622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:32.752840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:32.782100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1121/2240] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:29:32.782335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:32.797504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab31f-c5d6-4e05-9d53-9595345d3b10 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:32.818564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:32.819194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:32.819479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:32.819751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:32.820422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:32.822634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:32.905162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1120/2241] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:29:32.906613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:32.923678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffd2ea-836f-4898-998f-fa63c95c85b1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:33.000531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:33.002398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:33.002747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:33.003088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:33.005135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:33.006103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:33.032298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1122/2242] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:29:32 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:29:33.034374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:33.047102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5c950-ab66-423f-9d5b-8c5d51ed3ded admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:33.052171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:33.052877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:33.053215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:33.053502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:33.054205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:33.055778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:33.070171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1121/2243] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:29:33.071723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:33.083540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526d32-1b2c-4898-a5e0-a30aa5f7a662 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:33.089444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7b226-ad78-441d-837e-5615c50cd97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:33.090155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b226-ad78-441d-837e-5615c50cd97c admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:33.090597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b226-ad78-441d-837e-5615c50cd97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:33.090959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b226-ad78-441d-837e-5615c50cd97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:33.091700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7b226-ad78-441d-837e-5615c50cd97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:33.093508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7b226-ad78-441d-837e-5615c50cd97c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:33.106083 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1123/2244] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:29:33.110182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:33.120565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf9eb5-8a87-478c-aacc-af95fe85f9f5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:33.125349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:33.126098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:33.126379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:33.127199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] PATH_INFO: `/v3/projects/44c5dd80bee84a229a885df4a00b73db/users/84c99825bd9748cc8d508b6658fac6d9/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:33.142148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c5dd80bee84a229a885df4a00b73db, user_id=84c99825bd9748cc8d508b6658fac6d9, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:33.145651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:33.159696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1122/2245] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:29:33 2022] PUT /identity/v3/projects/44c5dd80bee84a229a885df4a00b73db/users/84c99825bd9748cc8d508b6658fac6d9/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:29:33.171006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f168-f45b-4ccd-820f-0d966648b111 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:33.171291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f168-f45b-4ccd-820f-0d966648b111 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:33.171566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f168-f45b-4ccd-820f-0d966648b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:33.216160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-04b5f168-f45b-4ccd-820f-0d966648b111 None None] MFA Rules not processed for user `84c99825bd9748cc8d508b6658fac6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:33.217441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-04b5f168-f45b-4ccd-820f-0d966648b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:33.283796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1124/2246] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:29:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:33.294988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:33.296736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:33.320377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:33.362590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda13c6-0b51-423b-bd13-bbced2f58e26 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:33.366326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:33.366936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:33.367216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:33.367487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:33.376662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:33.378596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:33.388207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1123/2247] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:37.236378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:37.237227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:37.237227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:37.257874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] MFA Rules not processed for user `9816bf0dcdcb443fb0cdfa25984bb746`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:37.259098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:37.273751 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:37.333691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1125/2248] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:29:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:29:40.831392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:40.833392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:40.894209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21240ef7-ae13-41c8-83c3-1bb80ecb4d1e service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:40.898024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:40.898981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:40.899266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:40.899540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:40.901870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:40.986365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:40.988122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece97bba-7bbb-440f-9ed2-68c3e30140cd service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:41.001725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1124/2249] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:41.836098 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:41.839867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:41.992010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a54c24-5603-4107-87cc-abc9fa1bd386 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:42.003330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:42.005055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:42.005490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:42.006501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:42.008963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:42.029163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:42.031897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:42.048999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1126/2250] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:50.996648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=67 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:52.039980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=49 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:52.400448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62601-ecb7-4bb7-ab4e-05e0d8625756 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:52.400948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62601-ecb7-4bb7-ab4e-05e0d8625756 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:52.401403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62601-ecb7-4bb7-ab4e-05e0d8625756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:52.424144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dfd62601-ecb7-4bb7-ab4e-05e0d8625756 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:52.426063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dfd62601-ecb7-4bb7-ab4e-05e0d8625756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:52.489813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1125/2251] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:52.517372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:52.518880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:52.603402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07fb7b-ccd7-41ad-89fa-40b731272bc8 service placement] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:52.610461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:52.611244 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:52.611807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:52.612190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:52.621934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:52.623681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:52.633627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1127/2252] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:30:02.482035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=25 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:02.629945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=32 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:03.054141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103520-620f-4fbe-9ef4-340147dd2b62 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:03.054565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103520-620f-4fbe-9ef4-340147dd2b62 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:03.055089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103520-620f-4fbe-9ef4-340147dd2b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:03.076773 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-35103520-620f-4fbe-9ef4-340147dd2b62 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:03.078441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-35103520-620f-4fbe-9ef4-340147dd2b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:03.168385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1126/2253] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:30:03.192934 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:03.194419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:03.284779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd458ff-35af-43de-b607-845183b897fe service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:03.290930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:03.291567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:03.291842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:03.292117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:03.302079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:03.303693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:03.321069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1128/2254] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:09.616589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a82bb-fda6-400e-8eaf-c06aff8f72d6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:09.617162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a82bb-fda6-400e-8eaf-c06aff8f72d6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:09.617162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a82bb-fda6-400e-8eaf-c06aff8f72d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:09.638119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cd1a82bb-fda6-400e-8eaf-c06aff8f72d6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:09.640755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cd1a82bb-fda6-400e-8eaf-c06aff8f72d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:09.649090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1127/2255] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:30:09.685242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:09.686675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:09.705135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14e1f-337e-40f0-bce8-a03949973ad2 service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:09.711573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e27af3-f1bc-49e8-8be1-631588d7e676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:09.712165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e27af3-f1bc-49e8-8be1-631588d7e676 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:09.712476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e27af3-f1bc-49e8-8be1-631588d7e676 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:09.712749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e27af3-f1bc-49e8-8be1-631588d7e676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:09.722100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e27af3-f1bc-49e8-8be1-631588d7e676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:09.723726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e27af3-f1bc-49e8-8be1-631588d7e676 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:09.733985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1129/2256] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:12.211575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea886f-490d-4897-af9f-bab239442950 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.212111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea886f-490d-4897-af9f-bab239442950 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.212303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea886f-490d-4897-af9f-bab239442950 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.213798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1128/2257] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:30:12.219847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d5af4-3125-4e9b-8250-2a598e0be283 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.220342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d5af4-3125-4e9b-8250-2a598e0be283 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.220564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d5af4-3125-4e9b-8250-2a598e0be283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.241377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-371d5af4-3125-4e9b-8250-2a598e0be283 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:12.242648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-371d5af4-3125-4e9b-8250-2a598e0be283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:12.252966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1130/2258] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:12.265772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea886f-490d-4897-af9f-bab239442950 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:12.269204 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-70ea886f-490d-4897-af9f-bab239442950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:12.333043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea886f-490d-4897-af9f-bab239442950 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:12.337362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98752c-9c60-4f1f-81f2-30f679b9ba17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:12.338014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98752c-9c60-4f1f-81f2-30f679b9ba17 service glance] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.338298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98752c-9c60-4f1f-81f2-30f679b9ba17 service glance] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.338603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98752c-9c60-4f1f-81f2-30f679b9ba17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.350940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98752c-9c60-4f1f-81f2-30f679b9ba17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:12.352529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98752c-9c60-4f1f-81f2-30f679b9ba17 service glance] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:12.364516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1129/2259] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:12.436268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce984c2-8e51-4ecc-9e35-25095b7a16ef None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.436577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce984c2-8e51-4ecc-9e35-25095b7a16ef None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.436845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce984c2-8e51-4ecc-9e35-25095b7a16ef None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.438269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1131/2260] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:30:12.443454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f1f2-902c-45aa-abc1-c8f47d1da9df None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.443801 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f1f2-902c-45aa-abc1-c8f47d1da9df None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.444343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42f1f2-902c-45aa-abc1-c8f47d1da9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.467432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fb42f1f2-902c-45aa-abc1-c8f47d1da9df None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:12.468914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fb42f1f2-902c-45aa-abc1-c8f47d1da9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:12.477507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1130/2261] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:12.490722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce984c2-8e51-4ecc-9e35-25095b7a16ef None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:12.493125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bce984c2-8e51-4ecc-9e35-25095b7a16ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:12.514108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce984c2-8e51-4ecc-9e35-25095b7a16ef None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:12.518380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d4752-3f40-492a-94b5-2173fab7be6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:12.519187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d4752-3f40-492a-94b5-2173fab7be6e service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.519885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d4752-3f40-492a-94b5-2173fab7be6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.520329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d4752-3f40-492a-94b5-2173fab7be6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.528654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d4752-3f40-492a-94b5-2173fab7be6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:12.530068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d4752-3f40-492a-94b5-2173fab7be6e service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:12.539062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1132/2262] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:12.630968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e447ce-7e20-4415-bda2-59f85038ea56 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.630968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e447ce-7e20-4415-bda2-59f85038ea56 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.630968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e447ce-7e20-4415-bda2-59f85038ea56 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.630968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1131/2263] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:30:12.636492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.636846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.637185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.657341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:12.658522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:12.667872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1133/2264] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:12.678992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e447ce-7e20-4415-bda2-59f85038ea56 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:12.689902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e447ce-7e20-4415-bda2-59f85038ea56 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:12.693529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9501165-c660-4af1-8da6-cf1d51413f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:12.694118 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501165-c660-4af1-8da6-cf1d51413f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:12.694397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501165-c660-4af1-8da6-cf1d51413f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:12.694668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501165-c660-4af1-8da6-cf1d51413f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:12.705210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501165-c660-4af1-8da6-cf1d51413f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:12.706639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9501165-c660-4af1-8da6-cf1d51413f7d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:12.717756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1132/2265] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:30:13.663600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:13.674089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52da1-31bd-434e-a214-6126e193d451 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:13.678667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:13.679346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:13.679624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:13.679913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] PATH_INFO: `/v3/users/84c99825bd9748cc8d508b6658fac6d9` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:13.681116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c99825bd9748cc8d508b6658fac6d9)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:13.683110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:13.732029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c99825bd9748cc8d508b6658fac6d9'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:13.745172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c99825bd9748cc8d508b6658fac6d9'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:13.753960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c99825bd9748cc8d508b6658fac6d9'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:13.754722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c99825bd9748cc8d508b6658fac6d9'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:13.763303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c99825bd9748cc8d508b6658fac6d9'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:13.770848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1134/2266] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:30:13 2022] DELETE /identity/v3/users/84c99825bd9748cc8d508b6658fac6d9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:30:13.775529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:13.776074 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:13.776179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:13.798115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:13.799555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:13.863582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1133/2267] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:30:13.874257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:13.876838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:13.898929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:13.940824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd625-773e-4146-b2cb-7a2314f093ae admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:13.945161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99710d93-d587-47ad-9b16-b2fa257b4216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:13.945978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99710d93-d587-47ad-9b16-b2fa257b4216 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:13.946263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99710d93-d587-47ad-9b16-b2fa257b4216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:13.946539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99710d93-d587-47ad-9b16-b2fa257b4216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:13.955902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99710d93-d587-47ad-9b16-b2fa257b4216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:13.957380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99710d93-d587-47ad-9b16-b2fa257b4216 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:13.966976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1135/2268] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:14.243920 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:14.245355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:14.258295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fcd17-c973-4cec-bbbe-7d86b05ed853 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:14.262854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:14.264140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:14.264478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:14.264749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] PATH_INFO: `/v3/projects/44c5dd80bee84a229a885df4a00b73db` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:14.266238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c5dd80bee84a229a885df4a00b73db)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:14.268287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:14.297389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:14.333951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c5dd80bee84a229a885df4a00b73db', 'request_id': 'req-65555a5a-f872-464d-8826-7f86d4138140'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:14.340568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c5dd80bee84a229a885df4a00b73db', 'request_id': 'req-65555a5a-f872-464d-8826-7f86d4138140'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:14.347297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c5dd80bee84a229a885df4a00b73db', 'request_id': 'req-65555a5a-f872-464d-8826-7f86d4138140'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:14.362158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] The token cache is being invalidate because project 44c5dd80bee84a229a885df4a00b73db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:30:14.362345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:14.362897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:30:14.364462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1134/2269] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:30:14 2022] DELETE /identity/v3/projects/44c5dd80bee84a229a885df4a00b73db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:30:14.556195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed94d-172f-410c-9be3-51e52b4f0624 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:14.556520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed94d-172f-410c-9be3-51e52b4f0624 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:14.556800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed94d-172f-410c-9be3-51e52b4f0624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:14.577815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e51ed94d-172f-410c-9be3-51e52b4f0624 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:14.579700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e51ed94d-172f-410c-9be3-51e52b4f0624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:14.656485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1136/2270] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:14.681454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:14.682868 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:14.758402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65555a5a-f872-464d-8826-7f86d4138140 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:14.764583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:14.765191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:14.765470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:14.765739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:14.775200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:14.776860 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:14.787834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1135/2271] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:17.112512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc621-6e9e-4bf3-875f-ea83779a6f6c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:17.112998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc621-6e9e-4bf3-875f-ea83779a6f6c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:17.113088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc621-6e9e-4bf3-875f-ea83779a6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:17.132997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f9dfc621-6e9e-4bf3-875f-ea83779a6f6c None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:17.134209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f9dfc621-6e9e-4bf3-875f-ea83779a6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:17.195015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1137/2272] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:30:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:17.207975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:17.209453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:17.307856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462835c-d3a6-48ba-b79c-0ff918764117 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:17.315388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:17.315999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:17.316313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:17.316593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:17.324636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:17.326245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:17.335567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1136/2273] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:30:27.187754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=70 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:27.332221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:37.281809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41cb61-49a9-4db6-9647-b6d11de12429 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:37.282317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41cb61-49a9-4db6-9647-b6d11de12429 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:37.282426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41cb61-49a9-4db6-9647-b6d11de12429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:37.302725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4f41cb61-49a9-4db6-9647-b6d11de12429 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:37.303951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4f41cb61-49a9-4db6-9647-b6d11de12429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:37.312110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1138/2274] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:37.336763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:37.338193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:37.355022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d2b4-e22a-486a-b12d-1d06f1a86180 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:37.361222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e6b35-9e6b-4a92-a38e-5e3e169eef56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:37.361834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6b35-9e6b-4a92-a38e-5e3e169eef56 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:37.362111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6b35-9e6b-4a92-a38e-5e3e169eef56 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:37.362382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6b35-9e6b-4a92-a38e-5e3e169eef56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:37.371109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e6b35-9e6b-4a92-a38e-5e3e169eef56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:37.372777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e6b35-9e6b-4a92-a38e-5e3e169eef56 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:37.383679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1137/2275] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:44.851913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:44.852551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:44.852551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:44.870957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] MFA Rules not processed for user `753c77f1591342c9936f104b2c7833fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:44.872143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:44.928754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1139/2276] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:45.626126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586685-ed69-4a9d-9de9-1c0ca8fe1ab4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:45.626675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586685-ed69-4a9d-9de9-1c0ca8fe1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:45.626759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3586685-ed69-4a9d-9de9-1c0ca8fe1ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:45.685680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a3586685-ed69-4a9d-9de9-1c0ca8fe1ab4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:45.687239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a3586685-ed69-4a9d-9de9-1c0ca8fe1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:45.699645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1138/2277] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Aug 17 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:45.722137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:45.747151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3c36e-d9e2-4766-be8b-ffe26254887e None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:45.756287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:45.757298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:45.757681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:45.758048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:45.767496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:45.770235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:45.781961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1140/2278] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:46.875804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:46.876730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:46.877150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:46.905385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:30:46.906680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:30:46.915248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1139/2279] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 17 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:30:46.930373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:46.942233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9190e-9965-48fd-a494-3c838c46a251 service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:46.947422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:46.948018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:46.948321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:46.948788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:46.957292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:46.958870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:46.967506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1141/2280] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:30:56.899979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=12 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:56.964135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=40 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:31:22.828066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:31:22.829558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:22.845225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9137021-137a-44ef-a2b9-c4b3b495ee54 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:31:22.849711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:31:22.850386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:31:22.850663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:31:22.850936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] PATH_INFO: `/v3/users/9816bf0dcdcb443fb0cdfa25984bb746` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:31:22.852062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9816bf0dcdcb443fb0cdfa25984bb746)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:31:22.854004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:31:22.898897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9816bf0dcdcb443fb0cdfa25984bb746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:22.906765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9816bf0dcdcb443fb0cdfa25984bb746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:22.907434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9816bf0dcdcb443fb0cdfa25984bb746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:22.908028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9816bf0dcdcb443fb0cdfa25984bb746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:22.914839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9816bf0dcdcb443fb0cdfa25984bb746'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:22.931606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1140/2281] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:31:22 2022] DELETE /identity/v3/users/9816bf0dcdcb443fb0cdfa25984bb746 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:31:23.105355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:31:23.116196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67f0f-d07a-442e-9820-5c512289c070 service swift] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:31:23.181864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:31:23.182584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:31:23.182890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:31:23.183190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] PATH_INFO: `/v3/projects/2ec4b900ecb941b0988cd1d1793bc85f` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:31:23.184390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec4b900ecb941b0988cd1d1793bc85f)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:31:23.186533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:31:23.236467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec4b900ecb941b0988cd1d1793bc85f', 'request_id': 'req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:23.244637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec4b900ecb941b0988cd1d1793bc85f', 'request_id': 'req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:23.250590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec4b900ecb941b0988cd1d1793bc85f', 'request_id': 'req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:23.261713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] The token cache is being invalidate because project 2ec4b900ecb941b0988cd1d1793bc85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:31:23.262000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:23.262634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:31:23.264163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1142/2282] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:31:23 2022] DELETE /identity/v3/projects/2ec4b900ecb941b0988cd1d1793bc85f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:31:32.928178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:31:33.258649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:31:33.261591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:31:33.264043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:33.336841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1e17-630a-4390-ac0a-7cc7ebb343b8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:31:33.391002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:31:33.391639 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:31:33.391917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:31:33.392189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:31:33.393981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:33.466861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:31:33.468463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:31:33.481638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1141/2283] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:31:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:31:37.019013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:31:37.020495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:37.096759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393095a-71a9-4a8d-853b-5ec8cfcca1a4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:31:37.100394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:31:37.101026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:31:37.101311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:31:37.101592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:31:37.103373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:37.117556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:31:37.118993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:31:37.130126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1143/2284] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:31:43.476967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=74 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:31:47.125359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=26 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:31:51.913066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:31:51.914487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:51.929209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ffc3-8d9c-46ee-b356-374ff96b8f00 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:31:51.934790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:31:51.935793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:31:51.936359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:31:51.936855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:31:51.939680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:52.003465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:31:52.005159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678280d-4f5b-4856-8ab8-654f0f0374ce service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:31:52.015147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1142/2285] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:31:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:31:52.681941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:31:52.683414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:52.697826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99133bc-565c-416e-a78e-3f2941877635 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:31:52.704696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:31:52.705298 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:31:52.705583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:31:52.705856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:31:52.707555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:31:52.767394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:31:52.769079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185d44-df7a-4817-a74d-70f49f192ca9 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:31:52.778297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1144/2286] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:31:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:00.003273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:00.003835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:00.003835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:00.025792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] MFA Rules not processed for user `95df35149a7842c2b8908aeb56516d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:00.027021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:00.034180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1143/2287] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:32:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:02.715461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:02.716579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:02.716579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:02.735039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] MFA Rules not processed for user `60612f26098a404f9d1323cc95ee6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:02.736301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:02.743358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1145/2288] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:03.079506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:03.089149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2f56e-3347-40fa-adad-a7ff666773b4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:03.093186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:03.093835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:03.094112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:03.094379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:03.096088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:03.105121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:03.107171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:03.114969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1144/2289] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:03.431071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:03.432566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:03.505970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b5460-05d7-49ea-b6d5-91ed20f6c74c None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:03.510904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:03.511488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:03.511767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:03.512036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:03.513916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:03.525023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:03.526585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:03.536318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1146/2290] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:05.958153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:05.960131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:05.974807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438eed-f38e-4860-9b15-8c7d16c18868 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:05.983840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:05.984777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:05.985252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:05.985690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:05.994374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:06.006600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:06.008175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:06.018846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1145/2291] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:13.532266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=63 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:16.014164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=43 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:16.908023 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:16.920153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b894e-7ea4-4e1d-aa18-f56e46c8b493 service placement] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:16.925750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:16.926425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:16.926779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:16.927060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:16.928855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:16.941246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:16.942833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:16.954300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1147/2292] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:26.949010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=6 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:44.316090 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:44.317576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:44.328742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc737cb-935f-4d8f-b468-4351252c00d9 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:44.332201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:44.332832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:44.333110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:44.333380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:44.335030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:44.395760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:44.397248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade94ece-7b8f-4f2f-8ae7-15aeddab7c01 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:44.407301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1146/2293] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:47.681071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:47.716965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dc412-803d-4ccf-9d98-cbdf5fd3213a service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:47.734045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:47.734683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:47.734966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:47.735241 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:47.742925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:47.779140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:47.780986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496be7-eb69-43fc-904c-f5c0b5565da3 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:47.800641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1148/2294] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:48.291336 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:48.291798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:48.292061 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:48.314495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] MFA Rules not processed for user `753c77f1591342c9936f104b2c7833fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:48.315719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:48.394469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1147/2295] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:32:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:52.107949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab3615-5f59-4330-ad73-1b41931b0839 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:52.108522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab3615-5f59-4330-ad73-1b41931b0839 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:52.108689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab3615-5f59-4330-ad73-1b41931b0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:52.128466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-cbab3615-5f59-4330-ad73-1b41931b0839 None None] MFA Rules not processed for user `4bf81750d77c422f8d99a0b7cbeea87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:52.129668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cbab3615-5f59-4330-ad73-1b41931b0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:52.136790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1149/2296] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:32:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:52.444978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:52.454470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c3e01-cdfb-432b-82e1-ec8fd8618a6f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:52.458883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:52.459557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:52.459931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:52.460440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:52.462262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:52.473564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:52.474990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:52.483549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1148/2297] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:55.664946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:55.665376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:55.665489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:55.685058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:55.686236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:55.742502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1150/2298] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 17 19:32:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:55.789770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:55.791232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:55.860037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfd945-e6a8-49d4-9338-58b8d2501bc2 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:55.864944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:55.865550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:55.865827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:55.866099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:55.873953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:55.875523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:55.883334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1149/2299] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:32:59.856611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:59.871195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ea064-032d-4cba-bfde-1927611864ee None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:59.882805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:59.883447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:59.883723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:59.883997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:59.888285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:59.902697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:59.904355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:59.928697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1151/2300] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:00.098804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:00.100267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:00.115761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8483e-89d7-4b41-937c-f864fe536998 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:00.121627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:00.122235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:00.122514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:00.122995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:00.125047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:00.138510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:00.140105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:00.151043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1150/2301] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:00.392043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:00.401863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f4ee-91f9-47fe-9644-e6e9fc76869a service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:00.406479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:00.407085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:00.407360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:00.407836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:00.410231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:00.422902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:00.425845 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:00.436238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1152/2302] 10.222.0.62 () {60 vars in 1396 bytes} [Wed Aug 17 19:33:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:03.704076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:03.718116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22b8e-9123-4270-bafc-4696aea3ed5e service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:03.725036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:03.725854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:03.726320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:03.726608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:03.728697 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:03.740852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:03.750565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:03.750565 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:03.764807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1151/2303] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:33:03.847042 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:03.848598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:03.963632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c123-1cb7-4517-9913-9b9645844da7 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:03.968166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:03.968820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:03.969096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:03.969364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] PATH_INFO: `/v3/users/aaeec711a15a45179b165e38402c9bd3` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:03.970462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaeec711a15a45179b165e38402c9bd3)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:03.972399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:04.031313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaeec711a15a45179b165e38402c9bd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.042424 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:04.044614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaeec711a15a45179b165e38402c9bd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.060081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaeec711a15a45179b165e38402c9bd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.060765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaeec711a15a45179b165e38402c9bd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.070238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaeec711a15a45179b165e38402c9bd3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.076490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1153/2304] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:03 2022] DELETE /identity/v3/users/aaeec711a15a45179b165e38402c9bd3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:04.271700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:04.290869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff779-2d58-4b07-a0cf-aaf62056f089 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:04.363621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:04.364289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:04.364713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:04.364993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] PATH_INFO: `/v3/projects/8e9ce2ede1cb461f933630409c52d8c2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:04.366177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9ce2ede1cb461f933630409c52d8c2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:04.368284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:04.425058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9ce2ede1cb461f933630409c52d8c2', 'request_id': 'req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.436901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9ce2ede1cb461f933630409c52d8c2', 'request_id': 'req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.443188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9ce2ede1cb461f933630409c52d8c2', 'request_id': 'req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.458138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] The token cache is being invalidate because project 8e9ce2ede1cb461f933630409c52d8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:04.458431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.459109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.460940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1152/2305] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:04 2022] DELETE /identity/v3/projects/8e9ce2ede1cb461f933630409c52d8c2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:33:04.465588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:04.467129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:04.481438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb17f73-86ac-483a-b04c-4441621b1240 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:04.555530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:04.556594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:04.556976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:04.557352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] PATH_INFO: `/v3/users/9c3976f199c54a1598f146225c862890` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:04.558864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3976f199c54a1598f146225c862890)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:04.561030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:04.628487 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3976f199c54a1598f146225c862890'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.644348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3976f199c54a1598f146225c862890'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.653437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3976f199c54a1598f146225c862890'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.654151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3976f199c54a1598f146225c862890'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.666383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3976f199c54a1598f146225c862890'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:04.673960 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1154/2306] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:04 2022] DELETE /identity/v3/users/9c3976f199c54a1598f146225c862890 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:33:05.431244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:05.433096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:05.447219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c3e7-cbe1-4834-9f3c-1866780f6f5c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:05.537102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:05.537738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:05.538151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:05.538434 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] PATH_INFO: `/v3/projects/b49dad7a7a964d0084adcdbfabb95671` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:05.539714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49dad7a7a964d0084adcdbfabb95671)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:05.543436 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:05.578988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:05.601076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49dad7a7a964d0084adcdbfabb95671', 'request_id': 'req-2514479f-4812-402d-9395-d2a47d0f8fb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:05.607483 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49dad7a7a964d0084adcdbfabb95671', 'request_id': 'req-2514479f-4812-402d-9395-d2a47d0f8fb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:05.613001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49dad7a7a964d0084adcdbfabb95671', 'request_id': 'req-2514479f-4812-402d-9395-d2a47d0f8fb2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:05.626150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] The token cache is being invalidate because project b49dad7a7a964d0084adcdbfabb95671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:05.626446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:05.627087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:05.628618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1153/2307] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:05 2022] DELETE /identity/v3/projects/b49dad7a7a964d0084adcdbfabb95671 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:14.670356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:DELETE=12,keystone:SELECT=60,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:15.622742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:24.433805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:24.435251 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:24.493255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18e5a9-d8de-428a-8d24-46c40fa9467c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:24.541777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:24.542521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:24.542797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:24.543063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:24.544795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:24.606757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:24.608217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:24.617580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1155/2308] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:33:27.798771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:27.800226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:27.814587 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514479f-4812-402d-9395-d2a47d0f8fb2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:27.819548 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:27.820178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:27.820496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:27.820770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] PATH_INFO: `/v3/users/95df35149a7842c2b8908aeb56516d9e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:27.821939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95df35149a7842c2b8908aeb56516d9e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:27.824880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:27.900643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95df35149a7842c2b8908aeb56516d9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:27.908601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95df35149a7842c2b8908aeb56516d9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:27.909203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95df35149a7842c2b8908aeb56516d9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:27.909799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95df35149a7842c2b8908aeb56516d9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:27.917542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29606acc-a300-4a9b-9db1-cdb666631a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95df35149a7842c2b8908aeb56516d9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:27.935865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1154/2309] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:27 2022] DELETE /identity/v3/users/95df35149a7842c2b8908aeb56516d9e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:28.120910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.132456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458683e9-abc3-49a2-9995-53f50e2943b0 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.191088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.191635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.191912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.192178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] PATH_INFO: `/v3/projects/32025e1eac624a0680ea34eec85c8125` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.193330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32025e1eac624a0680ea34eec85c8125)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.195214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.215146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:28.258828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32025e1eac624a0680ea34eec85c8125', 'request_id': 'req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:28.266265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32025e1eac624a0680ea34eec85c8125', 'request_id': 'req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:28.271866 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32025e1eac624a0680ea34eec85c8125', 'request_id': 'req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:28.282869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] The token cache is being invalidate because project 32025e1eac624a0680ea34eec85c8125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:28.283178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:28.283890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-f52c3b0d-d207-4fd6-84cc-5e18b6ce3f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:28.285589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1156/2310] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:28 2022] DELETE /identity/v3/projects/32025e1eac624a0680ea34eec85c8125 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:28.297242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.297536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.297819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.318603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:28.319921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:28.379961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1155/2311] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:28.388492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.388783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.389063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.411701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:28.413189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:28.422470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1157/2312] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:28.426758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.436643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c9f4-dd5c-4f79-9ec2-3fd70bbe379c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.441235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.441779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.442053 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.442325 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.442966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:33:28.443268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.444894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.456258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1156/2313] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:33:28.461107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.470803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c99dd-0447-4b6d-998e-1c881b02eb4d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.475419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.476006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.476314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.476589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.477229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.479801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.506169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1158/2314] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:28.510634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.521429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a365b0-2953-4160-bf0c-7b724d79c936 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.578651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.579252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.579530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.579802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.580476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.582383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.590826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:28.605778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1157/2315] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:33:28.610149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.621273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd5901-e643-4b28-9c88-0d884a7b5c04 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.625892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.626501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.626796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.627072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.627715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.629339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.639680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1159/2316] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:33:28.643601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.654400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8a87-62de-4961-befd-46e36d0aefe8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.659108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf43bae-33a5-4492-98df-0c397744cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.659703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43bae-33a5-4492-98df-0c397744cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.659986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43bae-33a5-4492-98df-0c397744cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.660295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43bae-33a5-4492-98df-0c397744cb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.660939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43bae-33a5-4492-98df-0c397744cb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.662512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43bae-33a5-4492-98df-0c397744cb9d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.674173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1158/2317] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:33:28.678312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.688400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807f07-8580-4286-871c-ea7efb78f3cf admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.693286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.693992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.694276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.694552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] PATH_INFO: `/v3/projects/8573d1602a2e4fefbbeea885220c1a10/users/98179784976a40b88df3c019f5a8246e/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.709760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8573d1602a2e4fefbbeea885220c1a10, user_id=98179784976a40b88df3c019f5a8246e, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.712741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.726417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1160/2318] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:28 2022] PUT /identity/v3/projects/8573d1602a2e4fefbbeea885220c1a10/users/98179784976a40b88df3c019f5a8246e/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:28.737078 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.737405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.737676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.765613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] MFA Rules not processed for user `98179784976a40b88df3c019f5a8246e`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:28.766813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:28.829924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1159/2319] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:28.834407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.896980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270640e-3463-44fe-b9e6-a69c49ebf689 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:28.902523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:28.903124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:28.903399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:28.903666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:28.904326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:28.906219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:28.933270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1161/2320] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:33:28.937442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:28.948578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24c8c-c490-477a-b1f7-672748156a1d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.003573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.004182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.004494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.004770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.005394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.007296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.029347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1160/2321] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:28 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:29.033361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.043733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe48678-3e34-4bd4-a874-af7651615033 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.048365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.048969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.049254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.049529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.050215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.051888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.062506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1162/2322] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:29.066547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.077170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a66af-0a0f-4eb8-b2d9-5599b51cba31 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.081788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.082452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.082725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.083004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] PATH_INFO: `/v3/projects/09856315c318418c86c5cd6570a2820c/users/58bc0b8c004844de9efc3f8fe465dd4a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.098292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09856315c318418c86c5cd6570a2820c, user_id=58bc0b8c004844de9efc3f8fe465dd4a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.100984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.113968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1161/2323] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:29 2022] PUT /identity/v3/projects/09856315c318418c86c5cd6570a2820c/users/58bc0b8c004844de9efc3f8fe465dd4a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:29.117750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.128206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34a33-2b35-41b9-9e78-1f34f6caf7d1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.131940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:29.187056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213760c-4b53-4d70-8b55-4b00d2090b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.187651 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213760c-4b53-4d70-8b55-4b00d2090b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.187927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213760c-4b53-4d70-8b55-4b00d2090b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.188198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213760c-4b53-4d70-8b55-4b00d2090b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.188862 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213760c-4b53-4d70-8b55-4b00d2090b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.191738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213760c-4b53-4d70-8b55-4b00d2090b81 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.203156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1163/2324] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:29.207366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.218675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b4d0-6ab8-404a-9343-c7c4bea6a693 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.223296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.223944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.224229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.224536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] PATH_INFO: `/v3/projects/09856315c318418c86c5cd6570a2820c/users/58bc0b8c004844de9efc3f8fe465dd4a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.226432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09856315c318418c86c5cd6570a2820c, user_id=58bc0b8c004844de9efc3f8fe465dd4a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.230365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.245993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1162/2325] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:29 2022] PUT /identity/v3/projects/09856315c318418c86c5cd6570a2820c/users/58bc0b8c004844de9efc3f8fe465dd4a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:29.257922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.258216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.258498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.286801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] MFA Rules not processed for user `58bc0b8c004844de9efc3f8fe465dd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:29.288013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:29.355892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1164/2326] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:29.367981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.369702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:29.391435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:29.428107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86d50b-5555-4dfd-ad1f-0ed62e585d14 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.431684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.432416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.432654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.432876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.441842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.443255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.453322 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1163/2327] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:29.768105 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.777799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aff1a-578a-40bc-a9ec-4166a75470d2 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.782391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58bc0b8c004844de9efc3f8fe465dd4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09856315c318418c86c5cd6570a2820c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.782997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.783283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.783566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.784203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:33:29.784538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.786129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.798369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1165/2328] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:33:29.802941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.812142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee37b0-7e37-4ab9-91d9-75bb491b7cf2 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.816982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58bc0b8c004844de9efc3f8fe465dd4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09856315c318418c86c5cd6570a2820c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.817617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.817909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.818188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.818886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.821146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.849408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1164/2329] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:29 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:29.853449 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.863901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6a67c-a104-4c6b-b4be-a877f01aea73 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.925151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58bc0b8c004844de9efc3f8fe465dd4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09856315c318418c86c5cd6570a2820c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.925766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.926054 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.926329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.926973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:33:29.927306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.928989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:29.942128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1166/2330] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:33:29.979100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:29.989293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61248-4f11-45ed-9969-93db07573fcf tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:29.993800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58bc0b8c004844de9efc3f8fe465dd4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09856315c318418c86c5cd6570a2820c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:29.994914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:29.995188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:29.995461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] PATH_INFO: `/v3/projects/fc593b7c064b4832a2a353beb3ef1fdc` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:29.996592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc593b7c064b4832a2a353beb3ef1fdc)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:29.998485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:30.045496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc593b7c064b4832a2a353beb3ef1fdc', 'request_id': 'req-2b953503-3b50-487d-83dd-48f901138a30'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.052069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc593b7c064b4832a2a353beb3ef1fdc', 'request_id': 'req-2b953503-3b50-487d-83dd-48f901138a30'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.058154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc593b7c064b4832a2a353beb3ef1fdc', 'request_id': 'req-2b953503-3b50-487d-83dd-48f901138a30'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.070382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] The token cache is being invalidate because project fc593b7c064b4832a2a353beb3ef1fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:30.070672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.071288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2b953503-3b50-487d-83dd-48f901138a30 tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.073481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1165/2331] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:29 2022] DELETE /identity/v3/projects/fc593b7c064b4832a2a353beb3ef1fdc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:30.263769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:30.265575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:30.276171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:30.328971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc429a-8d63-42b3-98c6-15e99e3b894f tempest-VolumeQuotaClassesTest-1133593751 tempest-VolumeQuotaClassesTest-1133593751-project-admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:30.384624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:30.385279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:30.385557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:30.385830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] PATH_INFO: `/v3/users/98179784976a40b88df3c019f5a8246e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:30.386943 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98179784976a40b88df3c019f5a8246e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:30.388883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:30.435007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98179784976a40b88df3c019f5a8246e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.446929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98179784976a40b88df3c019f5a8246e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.454398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98179784976a40b88df3c019f5a8246e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.455039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98179784976a40b88df3c019f5a8246e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.462202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98179784976a40b88df3c019f5a8246e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:30.468075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1167/2332] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:30 2022] DELETE /identity/v3/users/98179784976a40b88df3c019f5a8246e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:30.472531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:30.472818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:30.473091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:30.492035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:30.493207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:30.560123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1166/2333] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:30.569904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:30.571282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:30.611517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:30.630167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc125-e134-44b5-9e10-cce4a4f1d687 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:30.633742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:30.634336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:30.634612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:30.634881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:30.643760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:30.645204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:30.655089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1168/2334] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:30.931592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:30.933329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:30.949463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4056df-6865-47a8-8e6e-a6a872bb0622 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:30.957993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:30.958641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:30.958899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:30.959175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] PATH_INFO: `/v3/projects/8573d1602a2e4fefbbeea885220c1a10` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:30.960346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8573d1602a2e4fefbbeea885220c1a10)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:30.962599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:30.985846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:31.013147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8573d1602a2e4fefbbeea885220c1a10', 'request_id': 'req-f8cace30-8d9d-4bda-aa6c-749a5c856e28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.019352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8573d1602a2e4fefbbeea885220c1a10', 'request_id': 'req-f8cace30-8d9d-4bda-aa6c-749a5c856e28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.024915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8573d1602a2e4fefbbeea885220c1a10', 'request_id': 'req-f8cace30-8d9d-4bda-aa6c-749a5c856e28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.037848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] The token cache is being invalidate because project 8573d1602a2e4fefbbeea885220c1a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:31.038139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.038752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.040259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1167/2335] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:30 2022] DELETE /identity/v3/projects/8573d1602a2e4fefbbeea885220c1a10 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:31.044402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.054231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a03ec-83bd-49a6-9eeb-d62d10664e2c service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.110374 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.111001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.111280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.111552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] PATH_INFO: `/v3/users/58bc0b8c004844de9efc3f8fe465dd4a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.112936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bc0b8c004844de9efc3f8fe465dd4a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.114905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.160423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bc0b8c004844de9efc3f8fe465dd4a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.172008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bc0b8c004844de9efc3f8fe465dd4a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.179294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bc0b8c004844de9efc3f8fe465dd4a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.179936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bc0b8c004844de9efc3f8fe465dd4a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.186778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-acb3a5f6-dc80-4976-b786-6e1070bdfbf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bc0b8c004844de9efc3f8fe465dd4a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.192523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1169/2336] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:31 2022] DELETE /identity/v3/users/58bc0b8c004844de9efc3f8fe465dd4a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:31.459171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.460655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:31.474921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cace30-8d9d-4bda-aa6c-749a5c856e28 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.533306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.533936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.534210 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.534531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] PATH_INFO: `/v3/projects/09856315c318418c86c5cd6570a2820c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.535583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09856315c318418c86c5cd6570a2820c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.537570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.582872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09856315c318418c86c5cd6570a2820c', 'request_id': 'req-d4037040-05d1-4867-9282-182e5570f94a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.589767 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09856315c318418c86c5cd6570a2820c', 'request_id': 'req-d4037040-05d1-4867-9282-182e5570f94a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.595133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09856315c318418c86c5cd6570a2820c', 'request_id': 'req-d4037040-05d1-4867-9282-182e5570f94a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.607760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] The token cache is being invalidate because project 09856315c318418c86c5cd6570a2820c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:31.608044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.608672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d4037040-05d1-4867-9282-182e5570f94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:31.610124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1168/2337] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:31 2022] DELETE /identity/v3/projects/09856315c318418c86c5cd6570a2820c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:31.615078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.615567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.615743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.634794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:31.636004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:31.684900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:31.696833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1170/2338] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:31.705340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.705644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.705913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.726116 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:31.727307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:31.735092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1169/2339] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:31.739428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.749702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfabd2-e6ca-4054-ad8d-bb42a1992cbc None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.754390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.754988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.755268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.755562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.756202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:33:31.756558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.758179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.770075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1171/2340] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:33:31.774418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.784923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4c0d-efe3-46ee-bf5c-64c4c21dbd35 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.789731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.790353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.790634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.790909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.791669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.793608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.821862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1170/2341] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:31 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:31.826729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.836875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb00a0-ba59-454b-9a90-a048f07e258f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.891550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.892147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.892454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.892732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.893355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.895277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.915936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1172/2342] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:31 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:31.920024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.930380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcda70-298b-4113-a0d4-49d72a0afaec admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.934975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.935672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.935954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.936223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.936881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.938447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.940481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:31.950177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1171/2343] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:33:31.953727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.964571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952550-1cfb-4a22-8eb2-838600a9e114 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:31.969134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34e3d-2162-4657-a150-82ab53913ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:31.969725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34e3d-2162-4657-a150-82ab53913ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:31.970002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34e3d-2162-4657-a150-82ab53913ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:31.970272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34e3d-2162-4657-a150-82ab53913ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:31.970905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34e3d-2162-4657-a150-82ab53913ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:31.972531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34e3d-2162-4657-a150-82ab53913ebe admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:31.983249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1173/2344] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:31.987187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:31.997159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74153f4d-934d-4824-89d1-f5e3e502c86b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.001768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.002413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.002695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.002970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] PATH_INFO: `/v3/projects/bdc7c055a18f4166abbf453f23ae9b48/users/2a1e4eaa8a3941c68792492be6d80faa/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.018126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc7c055a18f4166abbf453f23ae9b48, user_id=2a1e4eaa8a3941c68792492be6d80faa, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.020907 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.034178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1172/2345] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:31 2022] PUT /identity/v3/projects/bdc7c055a18f4166abbf453f23ae9b48/users/2a1e4eaa8a3941c68792492be6d80faa/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:32.045712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.045939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.046213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.073435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] MFA Rules not processed for user `2a1e4eaa8a3941c68792492be6d80faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:32.074638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:32.140145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1174/2346] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:32.144691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.206014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353b97d-5f81-475e-ba95-93d2684104ca admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.210614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.211466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.211745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.212015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.212666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.214553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.240259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1173/2347] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:32 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:33:32.245843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.256917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9769-72e8-4fc7-96fe-24e0efc7e959 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.304516 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:32.315586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.316193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.316507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.316783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.317399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.319350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.340200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1175/2348] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:32 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:33:32.344332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.354673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5b9a-07a3-4fdc-90f1-06891aa7149f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.359287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.359882 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.360167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.360479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.361120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.362698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.373731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1174/2349] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:32.377769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.388948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0129f-29e6-4d02-93da-cbf8ac162de5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.393533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.394179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.394459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.394736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] PATH_INFO: `/v3/projects/f53876c321794ff3b2eec0772f5bb0b5/users/3c4e9830a42f4802966332d3dcc9680a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.409416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53876c321794ff3b2eec0772f5bb0b5, user_id=3c4e9830a42f4802966332d3dcc9680a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.412202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.426006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1176/2350] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:32 2022] PUT /identity/v3/projects/f53876c321794ff3b2eec0772f5bb0b5/users/3c4e9830a42f4802966332d3dcc9680a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:32.429960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.440622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed0fe-adf0-44a8-b208-a1e953ac7900 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.496765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0f832-a3b6-4692-a51f-28eabfba1a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.497364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0f832-a3b6-4692-a51f-28eabfba1a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.497642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0f832-a3b6-4692-a51f-28eabfba1a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.497908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0f832-a3b6-4692-a51f-28eabfba1a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.498533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0f832-a3b6-4692-a51f-28eabfba1a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.500120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0f832-a3b6-4692-a51f-28eabfba1a6c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.509893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1175/2351] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:33:32.514076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.524730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3f9dc-b596-4671-be07-645151458bb2 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.529362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.530010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.530290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.530562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] PATH_INFO: `/v3/projects/f53876c321794ff3b2eec0772f5bb0b5/users/3c4e9830a42f4802966332d3dcc9680a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.532467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53876c321794ff3b2eec0772f5bb0b5, user_id=3c4e9830a42f4802966332d3dcc9680a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.535174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.545979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1177/2352] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:32 2022] PUT /identity/v3/projects/f53876c321794ff3b2eec0772f5bb0b5/users/3c4e9830a42f4802966332d3dcc9680a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:33:32.558003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.558219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.558493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.586462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] MFA Rules not processed for user `3c4e9830a42f4802966332d3dcc9680a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:32.587662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:32.620805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:32.656399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1176/2353] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:32.668398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.670121 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:32.731292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165aa15-05a1-4c98-858d-6b14a4c784a8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.735327 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.735526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.735802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.736069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.745920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.747341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.756785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1178/2354] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:32.850049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:32.860874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1028e9f-ea76-4304-8026-40cbb63aa0f3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:32.865408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4e411-9c55-4a60-947c-6bf50f6cd283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:32.866272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e411-9c55-4a60-947c-6bf50f6cd283 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:32.866560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e411-9c55-4a60-947c-6bf50f6cd283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:32.866844 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e411-9c55-4a60-947c-6bf50f6cd283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:32.930551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4e411-9c55-4a60-947c-6bf50f6cd283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:32.932046 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4e411-9c55-4a60-947c-6bf50f6cd283 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:32.942121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1177/2355] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:37.656754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:37.718351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192a8e-ec5e-4ee9-8560-3ae5784e6891 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:37.722815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:37.723436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:37.723717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:37.723988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] PATH_INFO: `/v3/users/2a1e4eaa8a3941c68792492be6d80faa` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:37.725120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1e4eaa8a3941c68792492be6d80faa)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:37.727157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:37.774461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1e4eaa8a3941c68792492be6d80faa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:37.776594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:37.789428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1e4eaa8a3941c68792492be6d80faa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:37.797404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1e4eaa8a3941c68792492be6d80faa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:37.798210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1e4eaa8a3941c68792492be6d80faa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:37.805246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1e4eaa8a3941c68792492be6d80faa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:37.811976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1179/2356] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:37 2022] DELETE /identity/v3/users/2a1e4eaa8a3941c68792492be6d80faa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:37.816597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:37.817108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:37.817383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:37.838598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:37.839839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:37.898227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1178/2357] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:37.908461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:37.909844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:37.966739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1917b-7fca-4118-b183-ed69278acea9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:37.970364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:37.970963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:37.971240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:37.971505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:37.981009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:37.982437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:37.992128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1180/2358] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:38.252466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:38.255203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:38.268119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8072db-46b2-4aac-a8ab-51955ede3a26 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:38.273008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:38.273641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:38.273986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:38.274178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] PATH_INFO: `/v3/projects/bdc7c055a18f4166abbf453f23ae9b48` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:38.275960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc7c055a18f4166abbf453f23ae9b48)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:38.278229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:38.327808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc7c055a18f4166abbf453f23ae9b48', 'request_id': 'req-d3fb119c-11f7-4b03-85c7-69fde342c729'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.334494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc7c055a18f4166abbf453f23ae9b48', 'request_id': 'req-d3fb119c-11f7-4b03-85c7-69fde342c729'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.341331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc7c055a18f4166abbf453f23ae9b48', 'request_id': 'req-d3fb119c-11f7-4b03-85c7-69fde342c729'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.343089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:38.355217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] The token cache is being invalidate because project bdc7c055a18f4166abbf453f23ae9b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:38.355503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.356124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.357677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1179/2359] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:38 2022] DELETE /identity/v3/projects/bdc7c055a18f4166abbf453f23ae9b48 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:38.361678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:38.371822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b5649-5173-4c1a-877d-79d5ad7d1f25 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:38.429238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:38.429963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:38.430340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:38.430693 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] PATH_INFO: `/v3/users/3c4e9830a42f4802966332d3dcc9680a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:38.431946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4e9830a42f4802966332d3dcc9680a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:38.435149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:38.487450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4e9830a42f4802966332d3dcc9680a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.499154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4e9830a42f4802966332d3dcc9680a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.507311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4e9830a42f4802966332d3dcc9680a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.507915 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4e9830a42f4802966332d3dcc9680a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.509136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:38.517331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bbf9c2c3-fbd0-4be6-a849-494d1ce2e318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4e9830a42f4802966332d3dcc9680a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.523958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1181/2360] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:38 2022] DELETE /identity/v3/users/3c4e9830a42f4802966332d3dcc9680a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:38.793504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:38.794950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:38.810827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb119c-11f7-4b03-85c7-69fde342c729 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:38.872455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:38.873395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:38.873395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:38.873695 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] PATH_INFO: `/v3/projects/f53876c321794ff3b2eec0772f5bb0b5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:38.874943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53876c321794ff3b2eec0772f5bb0b5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:38.877494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:38.923066 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53876c321794ff3b2eec0772f5bb0b5', 'request_id': 'req-8ee93e6d-2e98-4525-8644-e898c9176ad1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.929206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53876c321794ff3b2eec0772f5bb0b5', 'request_id': 'req-8ee93e6d-2e98-4525-8644-e898c9176ad1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.935746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53876c321794ff3b2eec0772f5bb0b5', 'request_id': 'req-8ee93e6d-2e98-4525-8644-e898c9176ad1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.948913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] The token cache is being invalidate because project f53876c321794ff3b2eec0772f5bb0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:38.949195 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.949809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ee93e6d-2e98-4525-8644-e898c9176ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:38.951339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1180/2361] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:38 2022] DELETE /identity/v3/projects/f53876c321794ff3b2eec0772f5bb0b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:38.956400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:38.956883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:38.957077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:38.976712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:38.977961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:39.043951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1182/2362] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:39.051677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.051963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.052235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.072165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:39.074133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:39.081945 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1181/2363] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:39.086615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.096764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f75e3-8c00-4f89-911f-39d399faa958 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.101535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.102216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.102566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.102838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.103603 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:33:39.103896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.105562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.117532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1183/2364] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:33:39.122843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.133194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135739-2daf-45f5-8848-7e412e8ccff1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.139152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.139768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.140052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.140356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.141004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.142925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.177812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1182/2365] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:39 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:39.178893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.188959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa6650-6aa6-4a19-b4c9-dbd1506cda9d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.245784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.246392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.246673 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.246945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.247578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.249530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.270022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1184/2366] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:39 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:33:39.274108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.285060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9919253-b98f-42ed-be7c-fc0369b4bb4f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.289640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.290230 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.290510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.290802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.291816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.293457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.303240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1183/2367] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:39.307111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.316984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c62dbc-f51e-4e05-945c-2e889ff0bbf1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.321493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d24d4-723c-4775-ae0b-61cf08622458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.322625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d24d4-723c-4775-ae0b-61cf08622458 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.322903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d24d4-723c-4775-ae0b-61cf08622458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.323173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d24d4-723c-4775-ae0b-61cf08622458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.323805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d24d4-723c-4775-ae0b-61cf08622458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.325420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d24d4-723c-4775-ae0b-61cf08622458 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.458115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1185/2368] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:39.462338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.473213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f505b-f6bc-40fb-a0e9-e4e83b0851ed admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.477902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.478829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.479183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.479523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] PATH_INFO: `/v3/projects/46ae2c4c6c3042d69f337c404a652f35/users/73e0f7c28183453cb0244085b6ea9b8e/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.494538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ae2c4c6c3042d69f337c404a652f35, user_id=73e0f7c28183453cb0244085b6ea9b8e, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.497241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.511528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1184/2369] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:39 2022] PUT /identity/v3/projects/46ae2c4c6c3042d69f337c404a652f35/users/73e0f7c28183453cb0244085b6ea9b8e/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:39.524000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.524431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.524780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.554529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] MFA Rules not processed for user `73e0f7c28183453cb0244085b6ea9b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:39.555763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:39.605279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:39.628588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1186/2370] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:39.633028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.653369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:39.699496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb34e7-8869-4564-948e-69f4bde276a7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.704077 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.704737 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.705022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.705295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.705911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.707841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.737508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1185/2371] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:39 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:39.741534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.753094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f249e7-22e8-4cc6-94c2-7b0fd01776f9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.809186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.809782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.810063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.810335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.810963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.812906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.833984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1187/2372] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:39 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:39.838448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.848796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec88f8a-6d3f-4321-8bb2-75aea7892ad2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.854120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.854727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.855015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.855294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.855937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.857563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.868219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1186/2373] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:39.872860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.882727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352d1cb-a26e-4bb5-86e2-1de500cc1dc0 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.888587 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.889625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.890086 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.890551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] PATH_INFO: `/v3/projects/fff8dba913ab4b83bdc71183fc547618/users/62bd39eeddb54cd7b1cfbce34bc985fb/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.906707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff8dba913ab4b83bdc71183fc547618, user_id=62bd39eeddb54cd7b1cfbce34bc985fb, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.909399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:39.922127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1188/2374] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:39 2022] PUT /identity/v3/projects/fff8dba913ab4b83bdc71183fc547618/users/62bd39eeddb54cd7b1cfbce34bc985fb/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:39.926085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:39.936936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5ca9f-b1d0-478c-b5de-0aa03543908e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:39.994886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c124e9d-5fb2-427e-a301-2bd845769ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:39.995422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124e9d-5fb2-427e-a301-2bd845769ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:39.995700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124e9d-5fb2-427e-a301-2bd845769ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:39.995975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124e9d-5fb2-427e-a301-2bd845769ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:39.996645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c124e9d-5fb2-427e-a301-2bd845769ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:39.998243 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c124e9d-5fb2-427e-a301-2bd845769ae8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:40.008342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1187/2375] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:33:40.012663 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:40.022664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba6d9-057e-450d-bef6-ce854a0b1a72 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:40.027503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:40.028152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:40.028459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:40.028745 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] PATH_INFO: `/v3/projects/fff8dba913ab4b83bdc71183fc547618/users/62bd39eeddb54cd7b1cfbce34bc985fb/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:40.030643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff8dba913ab4b83bdc71183fc547618, user_id=62bd39eeddb54cd7b1cfbce34bc985fb, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:40.033300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:40.045011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1189/2376] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:40 2022] PUT /identity/v3/projects/fff8dba913ab4b83bdc71183fc547618/users/62bd39eeddb54cd7b1cfbce34bc985fb/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:40.055103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:40.055387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:40.055662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:40.082905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] MFA Rules not processed for user `62bd39eeddb54cd7b1cfbce34bc985fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:40.084401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:40.151545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1188/2377] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:40.163185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:40.164876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:40.221981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b634-8b31-48bb-83b5-3cd553b4e793 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:40.225709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:40.226310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:40.226588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:40.226857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:40.273949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:40.283675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:40.285140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:40.294560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1190/2378] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:44.514020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:44.515396 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:44.527714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea1be3-c0c7-4d8f-b30a-164610b8cd2b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:44.531186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288085b-2dbf-42eb-b488-a3a980a76d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:44.531789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288085b-2dbf-42eb-b488-a3a980a76d0c service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:44.532109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288085b-2dbf-42eb-b488-a3a980a76d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:44.532375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288085b-2dbf-42eb-b488-a3a980a76d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:44.541702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288085b-2dbf-42eb-b488-a3a980a76d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:44.543101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288085b-2dbf-42eb-b488-a3a980a76d0c service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:44.547999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:44.553353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1189/2379] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:49.439925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:49.501886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789ef9-bf07-4aa1-b7ff-1eaebf11fa1e service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:49.506381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:49.507002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:49.507279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:49.507551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] PATH_INFO: `/v3/users/73e0f7c28183453cb0244085b6ea9b8e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:49.508714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e0f7c28183453cb0244085b6ea9b8e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:49.510720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:49.565180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e0f7c28183453cb0244085b6ea9b8e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:49.577188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e0f7c28183453cb0244085b6ea9b8e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:49.584380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e0f7c28183453cb0244085b6ea9b8e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:49.584983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e0f7c28183453cb0244085b6ea9b8e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:49.592536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e0f7c28183453cb0244085b6ea9b8e'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:49.598304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1191/2380] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:49 2022] DELETE /identity/v3/users/73e0f7c28183453cb0244085b6ea9b8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:33:49.603666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:49.604898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:49.605157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:49.628131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:49.629356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:49.692857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1190/2381] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:49.703661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:49.705131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:49.769648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029dbd-819b-40f6-9f8e-c4ce19140f5d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:49.773472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:49.774074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:49.774351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:49.774619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:49.784635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:49.786051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:49.795538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1192/2382] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:50.106711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:50.108303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:50.122779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf16022-8e20-46a9-b456-98d9e45941b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:50.128542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:50.129235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:50.130125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:50.130125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] PATH_INFO: `/v3/projects/46ae2c4c6c3042d69f337c404a652f35` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:50.131618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ae2c4c6c3042d69f337c404a652f35)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:50.133641 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:50.196462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ae2c4c6c3042d69f337c404a652f35', 'request_id': 'req-14907f81-94f6-44c6-a09f-11236f0f58fb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.206442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ae2c4c6c3042d69f337c404a652f35', 'request_id': 'req-14907f81-94f6-44c6-a09f-11236f0f58fb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.214212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ae2c4c6c3042d69f337c404a652f35', 'request_id': 'req-14907f81-94f6-44c6-a09f-11236f0f58fb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.235256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] The token cache is being invalidate because project 46ae2c4c6c3042d69f337c404a652f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:50.235637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.236487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.242398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1191/2383] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:50 2022] DELETE /identity/v3/projects/46ae2c4c6c3042d69f337c404a652f35 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:33:50.246155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:50.263678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92060-86df-48f9-bb4f-b6b3563f98d4 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:50.273798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:50.340836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:50.341484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:50.343813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:50.344353 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] PATH_INFO: `/v3/users/62bd39eeddb54cd7b1cfbce34bc985fb` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:50.346489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=62bd39eeddb54cd7b1cfbce34bc985fb)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:50.350112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:50.406770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62bd39eeddb54cd7b1cfbce34bc985fb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.420171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62bd39eeddb54cd7b1cfbce34bc985fb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.427921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62bd39eeddb54cd7b1cfbce34bc985fb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.428563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62bd39eeddb54cd7b1cfbce34bc985fb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.435615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b2e2efd9-7b0b-472b-a88d-6c4b4c06b94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62bd39eeddb54cd7b1cfbce34bc985fb'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.441397 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1193/2384] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:33:50 2022] DELETE /identity/v3/users/62bd39eeddb54cd7b1cfbce34bc985fb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:50.717439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:50.718895 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:50.733676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14907f81-94f6-44c6-a09f-11236f0f58fb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:50.793559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:50.794196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:50.794479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:50.794755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] PATH_INFO: `/v3/projects/fff8dba913ab4b83bdc71183fc547618` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:50.795866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff8dba913ab4b83bdc71183fc547618)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:50.797798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:50.828369 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:50.847818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff8dba913ab4b83bdc71183fc547618', 'request_id': 'req-6a5ed772-4225-4d92-8962-1a9a92115541'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.854274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff8dba913ab4b83bdc71183fc547618', 'request_id': 'req-6a5ed772-4225-4d92-8962-1a9a92115541'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.860682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff8dba913ab4b83bdc71183fc547618', 'request_id': 'req-6a5ed772-4225-4d92-8962-1a9a92115541'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.874316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] The token cache is being invalidate because project fff8dba913ab4b83bdc71183fc547618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:33:50.874609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.875259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a5ed772-4225-4d92-8962-1a9a92115541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:33:50.876809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1192/2385] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:33:50 2022] DELETE /identity/v3/projects/fff8dba913ab4b83bdc71183fc547618 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:50.882749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:50.883034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:50.883296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:50.908956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:50.910169 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:50.975128 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1194/2386] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:50.983480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:50.983766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:50.984040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.004706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:51.005898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:51.014487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1193/2387] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:51.018800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.030987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7541-99f5-4395-a642-e7109894fb25 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.036761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.037357 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.037630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.037896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.038534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:33:51.038829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.040437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.055882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1195/2388] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:33:51.060958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.070253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7505eb-e576-42db-8c74-04c0c32c600f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.075664 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.076287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.076572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.076849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.077473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.079383 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.106986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1194/2389] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:51.111150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.122076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda70e5-b8dc-41ee-bd4b-aee571c763ac admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.139550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:51.180291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.180893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.181171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.181444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.182101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.184052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.210550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1196/2390] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:33:51 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:33:51.212223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.223841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e32e1-3e75-4714-bdeb-afc31cbd4e01 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.228805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.230047 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.230334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.230614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.231276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.232937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.251930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1195/2391] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:33:51.253268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.264886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40053-8921-40ea-8501-41de9873bbd8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.269569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283c9b-12d1-49fb-a7ae-b62d16d3dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.270174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283c9b-12d1-49fb-a7ae-b62d16d3dd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.270456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283c9b-12d1-49fb-a7ae-b62d16d3dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.270730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283c9b-12d1-49fb-a7ae-b62d16d3dd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.271377 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283c9b-12d1-49fb-a7ae-b62d16d3dd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.273293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283c9b-12d1-49fb-a7ae-b62d16d3dd05 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.286711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1197/2392] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:33:51.290546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.301182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87bce-a06c-43fb-a99d-06ef56e4348f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.305759 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.306401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.306681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.306975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] PATH_INFO: `/v3/projects/ed2b765d24f649e0aa0de925460a4973/users/6f54cfd53f60496fb7081da571542c85/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.322157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2b765d24f649e0aa0de925460a4973, user_id=6f54cfd53f60496fb7081da571542c85, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.325544 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.341024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1196/2393] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:33:51 2022] PUT /identity/v3/projects/ed2b765d24f649e0aa0de925460a4973/users/6f54cfd53f60496fb7081da571542c85/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:33:51.352473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1ecd-3aea-40e8-b40e-33f344cdc6d4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.352761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1ecd-3aea-40e8-b40e-33f344cdc6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.353034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1ecd-3aea-40e8-b40e-33f344cdc6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.383536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-22ac1ecd-3aea-40e8-b40e-33f344cdc6d4 None None] MFA Rules not processed for user `6f54cfd53f60496fb7081da571542c85`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:51.384801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-22ac1ecd-3aea-40e8-b40e-33f344cdc6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:51.467330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1198/2394] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:51.478146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.480163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:51.551616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31afb5-48f1-4097-85ed-0e30b421a6ac admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.555760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.556724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.557784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.558698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.568236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.570144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.580138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1197/2395] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:51.611017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ced01-8e96-4f06-a141-d80412a7185a None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.611365 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ced01-8e96-4f06-a141-d80412a7185a None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.611666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ced01-8e96-4f06-a141-d80412a7185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.632034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b25ced01-8e96-4f06-a141-d80412a7185a None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:33:51.633104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b25ced01-8e96-4f06-a141-d80412a7185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:51.694817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1199/2396] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:33:51.709489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:33:51.711242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:33:51.771238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:51.790179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c189b1-d48c-4903-a2c4-67608f3f5ade service glance] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:33:51.796969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc6ebe-81c9-486b-8f74-adb7e15e6517 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:33:51.797578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc6ebe-81c9-486b-8f74-adb7e15e6517 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:33:51.797859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc6ebe-81c9-486b-8f74-adb7e15e6517 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:33:51.798136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc6ebe-81c9-486b-8f74-adb7e15e6517 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:33:51.806417 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc6ebe-81c9-486b-8f74-adb7e15e6517 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:33:51.808605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc6ebe-81c9-486b-8f74-adb7e15e6517 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:33:51.817111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1198/2397] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:33:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:34:01.687262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:01.813752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:06.848116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844cd8-67d0-4c2c-bf1f-db8c978be246 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:06.848687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844cd8-67d0-4c2c-bf1f-db8c978be246 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:06.848687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844cd8-67d0-4c2c-bf1f-db8c978be246 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:06.850182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1200/2398] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:34:06.857976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94fafe-a6f8-4933-907b-5f4f464dbed2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:06.858428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94fafe-a6f8-4933-907b-5f4f464dbed2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:06.858704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94fafe-a6f8-4933-907b-5f4f464dbed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:06.880779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bc94fafe-a6f8-4933-907b-5f4f464dbed2 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:06.882082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bc94fafe-a6f8-4933-907b-5f4f464dbed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:06.957241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1199/2399] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:34:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:06.969667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844cd8-67d0-4c2c-bf1f-db8c978be246 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:06.971555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1b844cd8-67d0-4c2c-bf1f-db8c978be246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:06.984891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844cd8-67d0-4c2c-bf1f-db8c978be246 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:06.988594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c0aa5-59bd-490b-ae56-275dde213d01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:06.989197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0aa5-59bd-490b-ae56-275dde213d01 service glance] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:06.989475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0aa5-59bd-490b-ae56-275dde213d01 service glance] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:06.989750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c0aa5-59bd-490b-ae56-275dde213d01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.000523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c0aa5-59bd-490b-ae56-275dde213d01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:07.001953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c0aa5-59bd-490b-ae56-275dde213d01 service glance] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:07.013675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1201/2400] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:07.085749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa59f-b2c1-40f5-bf69-132048e71ba9 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:07.086289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa59f-b2c1-40f5-bf69-132048e71ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:07.086564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa59f-b2c1-40f5-bf69-132048e71ba9 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.088564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1200/2401] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:34:07.093873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af74c-6255-4e16-83de-aadd10a088c2 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:07.094156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af74c-6255-4e16-83de-aadd10a088c2 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:07.094454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af74c-6255-4e16-83de-aadd10a088c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.113488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-681af74c-6255-4e16-83de-aadd10a088c2 None None] MFA Rules not processed for user `fcd37115dc7f468cb67bcb79af5e89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:07.114608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-681af74c-6255-4e16-83de-aadd10a088c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:07.165631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1202/2402] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:07.177805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa59f-b2c1-40f5-bf69-132048e71ba9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:07.179453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-112fa59f-b2c1-40f5-bf69-132048e71ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:07.192896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa59f-b2c1-40f5-bf69-132048e71ba9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:07.196386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64def8-ff6f-48be-a1cb-da6be27d37fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:07.196978 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64def8-ff6f-48be-a1cb-da6be27d37fd service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:07.197823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64def8-ff6f-48be-a1cb-da6be27d37fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:07.198096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64def8-ff6f-48be-a1cb-da6be27d37fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.205004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64def8-ff6f-48be-a1cb-da6be27d37fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:07.206422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64def8-ff6f-48be-a1cb-da6be27d37fd service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:07.216321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1201/2403] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:07.300061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d037-5ca7-4056-af32-b1122965e433 None None] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:07.300370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d037-5ca7-4056-af32-b1122965e433 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:07.300644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d037-5ca7-4056-af32-b1122965e433 None None] PATH_INFO: `/` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.302010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1203/2404] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 17 19:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:34:07.307244 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb281e-9446-48dc-b821-32089b6221b3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:07.307531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb281e-9446-48dc-b821-32089b6221b3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:07.307805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb281e-9446-48dc-b821-32089b6221b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.327728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e5eb281e-9446-48dc-b821-32089b6221b3 None None] MFA Rules not processed for user `880e3ed0ab1641a3bdab9ff349d09286`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:07.328969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e5eb281e-9446-48dc-b821-32089b6221b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:07.338721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1202/2405] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 17 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:07.348982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674d037-5ca7-4056-af32-b1122965e433 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:07.360362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674d037-5ca7-4056-af32-b1122965e433 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:07.364078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:07.364662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:07.364941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:07.365213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:07.376035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:07.377498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:07.388396 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1204/2406] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:09.108666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:09.109139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:09.109234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:09.129927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:09.131132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:09.139329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1203/2407] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:34:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:09.151122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:09.162114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688981-3038-4fba-b45b-207c5087638d service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:09.167039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331ffdf-1908-47ab-b6c6-446b6b0a9df4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:09.167618 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331ffdf-1908-47ab-b6c6-446b6b0a9df4 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:09.167897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331ffdf-1908-47ab-b6c6-446b6b0a9df4 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:09.168168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331ffdf-1908-47ab-b6c6-446b6b0a9df4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:09.176150 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331ffdf-1908-47ab-b6c6-446b6b0a9df4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:09.177748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331ffdf-1908-47ab-b6c6-446b6b0a9df4 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:09.186360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1205/2408] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:34:12.521250 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:12.593134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c3e5-0d8a-4db2-8b03-d1db7be7c5a3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:12.598251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:12.598973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:12.599324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:12.599667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] PATH_INFO: `/v3/users/6f54cfd53f60496fb7081da571542c85` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:12.600954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f54cfd53f60496fb7081da571542c85)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:12.602967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:12.666402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f54cfd53f60496fb7081da571542c85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:12.674861 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f54cfd53f60496fb7081da571542c85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:12.675507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f54cfd53f60496fb7081da571542c85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:12.676103 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f54cfd53f60496fb7081da571542c85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:12.683990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f54cfd53f60496fb7081da571542c85'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:12.688562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:12.703705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1204/2409] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:34:12 2022] DELETE /identity/v3/users/6f54cfd53f60496fb7081da571542c85 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:12.708214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:12.708708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:12.708931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:12.730547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:12.731740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:12.792758 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1206/2410] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:12.804366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:12.805856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:12.874005 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ab58a-b91b-427e-b27d-c9228f5441d0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:12.877950 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab582d-0f36-4fb8-84ec-ea0b4b010019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:12.878581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab582d-0f36-4fb8-84ec-ea0b4b010019 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:12.878852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab582d-0f36-4fb8-84ec-ea0b4b010019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:12.879129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab582d-0f36-4fb8-84ec-ea0b4b010019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:12.901138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab582d-0f36-4fb8-84ec-ea0b4b010019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:12.902770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab582d-0f36-4fb8-84ec-ea0b4b010019 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:12.913660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1205/2411] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:34:13.222727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.224174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:13.236596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f54f-b6f1-47e5-b740-ad3d90c92095 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.241242 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.241994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.242280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.242552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] PATH_INFO: `/v3/projects/ed2b765d24f649e0aa0de925460a4973` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.243688 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2b765d24f649e0aa0de925460a4973)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.246195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.306576 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2b765d24f649e0aa0de925460a4973', 'request_id': 'req-154bcfe0-9c31-400d-9c52-55a87a9f1271'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:13.335010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2b765d24f649e0aa0de925460a4973', 'request_id': 'req-154bcfe0-9c31-400d-9c52-55a87a9f1271'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:13.343836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2b765d24f649e0aa0de925460a4973', 'request_id': 'req-154bcfe0-9c31-400d-9c52-55a87a9f1271'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:13.345564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:13.369074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] The token cache is being invalidate because project ed2b765d24f649e0aa0de925460a4973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:34:13.371153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:13.372197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-154bcfe0-9c31-400d-9c52-55a87a9f1271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:13.375259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1207/2412] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:34:13 2022] DELETE /identity/v3/projects/ed2b765d24f649e0aa0de925460a4973 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:13.380562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.380992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.381297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.408783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:13.410367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:13.474448 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1206/2413] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:34:13.482703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.482983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.483250 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.503589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:13.504833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:13.512855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1208/2414] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:13.517513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.529068 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb14571-aa4a-4f8b-b08c-978152e50880 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.533704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.534306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.534710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.534996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.535677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:34:13.535982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.537644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.549612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1207/2415] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:34:13.553907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.563672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40986fba-9f08-46ec-8248-821c39a48f57 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.568351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.568937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.569214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.569482 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.570091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.572047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.599669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1209/2416] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:34:13 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:34:13.604843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.615174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c375-aac7-4dc9-90bd-3fbf2548d032 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.677008 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.677897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.678363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.678821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.679617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.681611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.703500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1208/2417] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:34:13 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:34:13.707648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.719219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6939c2-9592-46c1-b6a9-51ced865e260 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.723779 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.724402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.724684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.724962 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.725604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.727184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.737436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1210/2418] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:34:13.741500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.750355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:13.754985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3218913-4a79-45e6-bcc0-1f914878a789 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.762349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30e199-7e22-48dd-bd68-1ae81e473604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.763073 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30e199-7e22-48dd-bd68-1ae81e473604 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.763364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30e199-7e22-48dd-bd68-1ae81e473604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.763897 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30e199-7e22-48dd-bd68-1ae81e473604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.764784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30e199-7e22-48dd-bd68-1ae81e473604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.766580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30e199-7e22-48dd-bd68-1ae81e473604 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.783492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1209/2419] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:34:13.788167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.798286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43a8a-cef5-4253-b7c9-ceab82b81f9e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:13.802861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:13.803500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.803777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.804044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] PATH_INFO: `/v3/projects/a75987e4851447cc93b0d2a1a95a22dd/users/9b5a89f11e7b4fe88c6bcc9f08690236/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.817998 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75987e4851447cc93b0d2a1a95a22dd, user_id=9b5a89f11e7b4fe88c6bcc9f08690236, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:13.820645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:13.833294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1211/2420] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:34:13 2022] PUT /identity/v3/projects/a75987e4851447cc93b0d2a1a95a22dd/users/9b5a89f11e7b4fe88c6bcc9f08690236/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:13.845416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:13.845704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:13.845979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:13.878507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] MFA Rules not processed for user `9b5a89f11e7b4fe88c6bcc9f08690236`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:13.879635 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:13.948879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1210/2421] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:13.959890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:13.962230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:14.047626 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489c20-1acc-4b13-973d-29adb224680f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:14.051526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d885df7-1df1-4447-b114-027d30baae65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:14.052216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d885df7-1df1-4447-b114-027d30baae65 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:14.052533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d885df7-1df1-4447-b114-027d30baae65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:14.052806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d885df7-1df1-4447-b114-027d30baae65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:14.066715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d885df7-1df1-4447-b114-027d30baae65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:14.068308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d885df7-1df1-4447-b114-027d30baae65 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:14.079191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1212/2422] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:34:23.954965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=35 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:24.074778 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:24.563470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:24.626219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164245-5b89-4836-bc08-58b6b9e0dde7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:24.630921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:24.631553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:24.631836 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:24.632112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] PATH_INFO: `/v3/users/9b5a89f11e7b4fe88c6bcc9f08690236` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:24.633271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5a89f11e7b4fe88c6bcc9f08690236)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:24.635684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:24.681847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5a89f11e7b4fe88c6bcc9f08690236'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:24.689267 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5a89f11e7b4fe88c6bcc9f08690236'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:24.689902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5a89f11e7b4fe88c6bcc9f08690236'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:24.690477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5a89f11e7b4fe88c6bcc9f08690236'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:24.698163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5a89f11e7b4fe88c6bcc9f08690236'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:24.716426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1211/2423] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:34:24 2022] DELETE /identity/v3/users/9b5a89f11e7b4fe88c6bcc9f08690236 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:24.720999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:24.721376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:24.721657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:24.740434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:24.741627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:24.798793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1213/2424] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:24.808579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:24.810018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:24.866701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc177e94-0f7f-4446-bf15-4b185df8967a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:24.871745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6f383-f7bb-4ea8-80a7-e05ab272fff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:24.872808 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f383-f7bb-4ea8-80a7-e05ab272fff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:24.873319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f383-f7bb-4ea8-80a7-e05ab272fff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:24.873833 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6f383-f7bb-4ea8-80a7-e05ab272fff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:24.884937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6f383-f7bb-4ea8-80a7-e05ab272fff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:24.886380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6f383-f7bb-4ea8-80a7-e05ab272fff6 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:24.897735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1212/2425] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:25.268992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.270403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:25.282594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b93b3-1dd8-4786-b615-e2ef9257d77d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.287101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.287735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.288008 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.288307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] PATH_INFO: `/v3/projects/a75987e4851447cc93b0d2a1a95a22dd` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.289442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75987e4851447cc93b0d2a1a95a22dd)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.291905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.340064 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75987e4851447cc93b0d2a1a95a22dd', 'request_id': 'req-89f5e624-49ef-4441-a449-87293874908a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:25.347270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75987e4851447cc93b0d2a1a95a22dd', 'request_id': 'req-89f5e624-49ef-4441-a449-87293874908a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:25.353544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75987e4851447cc93b0d2a1a95a22dd', 'request_id': 'req-89f5e624-49ef-4441-a449-87293874908a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:25.365281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] The token cache is being invalidate because project a75987e4851447cc93b0d2a1a95a22dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:34:25.365572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:25.366214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-89f5e624-49ef-4441-a449-87293874908a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:34:25.367683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1214/2426] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:34:25 2022] DELETE /identity/v3/projects/a75987e4851447cc93b0d2a1a95a22dd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:25.372948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.373432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.373552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.392172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:25.393371 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:25.410745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:25.460397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1213/2427] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:25.468951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.469239 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.469535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.489336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:25.490535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:25.498885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1215/2428] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:25.503049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.513762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e253b6-f2a8-4486-b9e5-2412e4076642 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.518466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.519070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.519349 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.519619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.520275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:34:25.520693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.522374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.535883 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1214/2429] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:34:25.540403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.550171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbafee-05bd-4632-aa27-c53794ab59cd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.554797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.555387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.555666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.555936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.556790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.558675 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.589317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1216/2430] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:34:25 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:34:25.593772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.605823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ff053-f26e-4efe-b6a3-6b3640b91ab1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.662666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.663272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.663555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.663832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.664491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.667583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.688875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1215/2431] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:34:25 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:34:25.693034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.703918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27243b9-a1e8-42b4-af4d-c275f74dde03 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.708687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.709307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.709590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.709863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.710505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.713421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.723277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1217/2432] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:34:25.727122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.737782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536660-382e-4018-9143-31481d93dafc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.742694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308f01-5fbd-41b0-9bfd-d413a15a5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.743416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308f01-5fbd-41b0-9bfd-d413a15a5df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.745183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308f01-5fbd-41b0-9bfd-d413a15a5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.745401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308f01-5fbd-41b0-9bfd-d413a15a5df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.746181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308f01-5fbd-41b0-9bfd-d413a15a5df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.747851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308f01-5fbd-41b0-9bfd-d413a15a5df2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.758914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1216/2433] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:34:25.764122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.774077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e6f3-d429-4cfa-840a-4e85ac75c20b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.779909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.780584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.780869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.781146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] PATH_INFO: `/v3/projects/29d3dfd9c8284c259e1893d6a3fc5207/users/394b6f2e1978417fa6d7a74d74ef4268/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.796832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d3dfd9c8284c259e1893d6a3fc5207, user_id=394b6f2e1978417fa6d7a74d74ef4268, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.799472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.812353 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1218/2434] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:34:25 2022] PUT /identity/v3/projects/29d3dfd9c8284c259e1893d6a3fc5207/users/394b6f2e1978417fa6d7a74d74ef4268/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:25.817344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49cd6e-9776-4226-91bf-748b9fc64616 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.817636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49cd6e-9776-4226-91bf-748b9fc64616 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.817912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49cd6e-9776-4226-91bf-748b9fc64616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.837076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ee49cd6e-9776-4226-91bf-748b9fc64616 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:25.838924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee49cd6e-9776-4226-91bf-748b9fc64616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:25.896612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1217/2435] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:25.906753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:25.908490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:25.929749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:25.968844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609d19-656d-44c1-9b11-2967d692dbbe admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:25.972501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:25.973104 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:25.973385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:25.973657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:25.983339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:25.984803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:25.994756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1219/2436] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:30.153305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.153832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.153832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.193872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] MFA Rules not processed for user `394b6f2e1978417fa6d7a74d74ef4268`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:30.195180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:30.204605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:30.286172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1218/2437] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:30.291168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:30.369218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bf206-7173-4627-9e65-e1b785844324 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:30.373996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:30.374617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.374896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.375168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.375795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:30.377746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:30.420760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1220/2438] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:34:30 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:34:30.424738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:30.436938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a154074-fb06-4c93-8298-5ea290caafe5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:30.498506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:30.499128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.499531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.499669 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.500345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:30.502276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:30.526896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1219/2439] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:34:30 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:34:30.531004 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:30.542094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530c859-cd5a-4dc3-bd88-1242efb8f51c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:30.546781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:30.547399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.547706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.547977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.548660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:30.550276 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:30.562378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1221/2440] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:34:30.566657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:30.586905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ac93-bccd-4a6d-b232-1adc43ce2864 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:30.592523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:30.593198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.593480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.593874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] PATH_INFO: `/v3/projects/42ef74347d6e402d9eb6d653884a22c9/users/ad78f08f086343029b6eb4799c0c2d73/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.610707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ef74347d6e402d9eb6d653884a22c9, user_id=ad78f08f086343029b6eb4799c0c2d73, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:30.613914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:30.628431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1220/2441] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:34:30 2022] PUT /identity/v3/projects/42ef74347d6e402d9eb6d653884a22c9/users/ad78f08f086343029b6eb4799c0c2d73/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:30.632613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:30.643518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec17a3-6fd4-40f4-9f5b-cb6da4826349 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:30.702733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad84ccb-7e54-492e-bac1-76ea83f8c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:30.703163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad84ccb-7e54-492e-bac1-76ea83f8c37b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.703440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad84ccb-7e54-492e-bac1-76ea83f8c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.703708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad84ccb-7e54-492e-bac1-76ea83f8c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.704383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad84ccb-7e54-492e-bac1-76ea83f8c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:30.706073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad84ccb-7e54-492e-bac1-76ea83f8c37b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:30.717733 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1222/2442] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:34:30.721913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:30.738299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12670-0475-44e6-b5dd-3035d31eb56f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:30.744684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:30.745457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.745804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.746145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] PATH_INFO: `/v3/projects/42ef74347d6e402d9eb6d653884a22c9/users/ad78f08f086343029b6eb4799c0c2d73/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.749145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ef74347d6e402d9eb6d653884a22c9, user_id=ad78f08f086343029b6eb4799c0c2d73, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:30.751623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:30.763975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1221/2443] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:34:30 2022] PUT /identity/v3/projects/42ef74347d6e402d9eb6d653884a22c9/users/ad78f08f086343029b6eb4799c0c2d73/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:34:30.856658 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72a20-e057-4867-abb9-7432f0f37212 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:30.856946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72a20-e057-4867-abb9-7432f0f37212 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:30.857368 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72a20-e057-4867-abb9-7432f0f37212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:30.885739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-7fa72a20-e057-4867-abb9-7432f0f37212 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:30.886988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7fa72a20-e057-4867-abb9-7432f0f37212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:30.951955 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:31.068233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1223/2444] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 17 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:31.088689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:31.090463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:31.192949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:31.255806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea41de-22af-419d-8f99-d56a8dcedf0c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:31.263320 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:31.264057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:31.264428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:31.264827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:31.282515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:31.284912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:31.312984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1222/2445] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:34:35.660925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33c29-510f-40ef-9179-694230ab7dfd None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:35.661465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33c29-510f-40ef-9179-694230ab7dfd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:35.661465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33c29-510f-40ef-9179-694230ab7dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:35.693401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-65d33c29-510f-40ef-9179-694230ab7dfd None None] MFA Rules not processed for user `ad78f08f086343029b6eb4799c0c2d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:35.695633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-65d33c29-510f-40ef-9179-694230ab7dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:35.818890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1224/2446] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:35.835216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:35.836741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:35.953838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2188b-f405-4716-b177-83ec1782a9a3 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:35.965226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:35.966115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:35.966578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:35.967057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:36.040665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:36.042442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:36.052209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1223/2447] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:37.167295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19cc4f-f70d-4234-bd7f-9c48e6e207dc None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:37.167794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19cc4f-f70d-4234-bd7f-9c48e6e207dc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:37.167905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19cc4f-f70d-4234-bd7f-9c48e6e207dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:37.187767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8f19cc4f-f70d-4234-bd7f-9c48e6e207dc None None] MFA Rules not processed for user `394b6f2e1978417fa6d7a74d74ef4268`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:37.188992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8f19cc4f-f70d-4234-bd7f-9c48e6e207dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:37.197553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1225/2448] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:34:42.872760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:34:42.874345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:42.969033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:43.045600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf36cd7-282e-469e-8272-d65c9bc6d15b service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:34:43.046733 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:34:43.047365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:43.047637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:43.047915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:43.049734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:43.064094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:34:43.065847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:34:43.085080 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1224/2449] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:34:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:34:45.673696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:34:45.674225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:34:45.674225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:34:45.693065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] MFA Rules not processed for user `753c77f1591342c9936f104b2c7833fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:34:45.694269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:34:45.754216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1226/2450] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:34:53.081034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=18 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:55.746597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=81 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:06.860870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:06.862359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:06.942856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565558ec-4b97-4573-b88f-d9fe55d9587c service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:06.947266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:06.947871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:06.948147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:06.948447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:06.950149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:07.020102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:07.021607 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:07.032380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1225/2451] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:10.531527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:10.533165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:10.548574 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caff2f3-160b-4fbe-a052-a7435f435005 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:10.553214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:10.553852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:10.554132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:10.554440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] PATH_INFO: `/v3/users/4bf81750d77c422f8d99a0b7cbeea87c` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:10.556315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf81750d77c422f8d99a0b7cbeea87c)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:10.558248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:10.608721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf81750d77c422f8d99a0b7cbeea87c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.621671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf81750d77c422f8d99a0b7cbeea87c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.629016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf81750d77c422f8d99a0b7cbeea87c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.629606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf81750d77c422f8d99a0b7cbeea87c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.636734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-777ade62-b1c9-4730-8bab-a6d6fb162c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf81750d77c422f8d99a0b7cbeea87c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.642589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1227/2452] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:10 2022] DELETE /identity/v3/users/4bf81750d77c422f8d99a0b7cbeea87c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:10.816516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:10.826964 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdc7bb-db19-4b50-a687-0c0ae18fd4d0 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:10.894214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:10.894756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:10.895036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:10.895305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] PATH_INFO: `/v3/projects/16693c7d794a4615bcd154dc76de893c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:10.896442 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16693c7d794a4615bcd154dc76de893c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:10.898382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:10.934825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:10.951392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16693c7d794a4615bcd154dc76de893c', 'request_id': 'req-746df139-3029-477c-9823-e70ec07d2504'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.958563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16693c7d794a4615bcd154dc76de893c', 'request_id': 'req-746df139-3029-477c-9823-e70ec07d2504'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.967226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16693c7d794a4615bcd154dc76de893c', 'request_id': 'req-746df139-3029-477c-9823-e70ec07d2504'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.989996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] The token cache is being invalidate because project 16693c7d794a4615bcd154dc76de893c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:10.990295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.990943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-746df139-3029-477c-9823-e70ec07d2504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:10.992494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1226/2453] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:10 2022] DELETE /identity/v3/projects/16693c7d794a4615bcd154dc76de893c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:10.998030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:10.998315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:10.998591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.070264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:11.072039 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:11.132486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1228/2454] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:11.140420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.140567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.140852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.162452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:11.163768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:11.173072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1227/2455] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:11.177399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.187823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d55cff-fb9a-4162-bbd8-40e1df8555a6 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.199562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.200262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.200555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.200829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.201499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:11.201808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.203421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.216828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1229/2456] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:11.221226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.231245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817abc-c59e-45a9-b367-ed1886e160a0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.236173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.237014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.237301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.237572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.238212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.240138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.272076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1228/2457] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:11 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:11.273282 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.284990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9918c-b2dd-47f5-9b12-5bc9de26ffed admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.313583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:11.314585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.316409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:11.348741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.349352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.349624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.349888 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.350498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.352478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.375291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1230/2458] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:11 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:11.378674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571f83b-7dec-4515-9557-c00487c9b964 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.379489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.389340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.390020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.390246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.390558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.392398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:11.392941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cbd80-78b1-4801-8d20-980e267d3613 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.398099 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.399794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.400178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.400683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.401338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.402974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.416682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1231/2459] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:35:11.417704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.427333 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e16eff-17ef-4739-9bbf-a7b0d0476033 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.433227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.433950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.434332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.434610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.435252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.436945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.448609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1232/2460] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:11.452640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.463390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c3d09-a1c1-4045-9ab1-34006531c965 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.466064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.467734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47096dd7-f2e4-40c6-80f2-61f52e56eb53 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.468697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.469362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.469635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.469905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] PATH_INFO: `/v3/projects/2a3eb8ea836847f3941b03cf554d8694/users/8b1c88a968dc4d1bb4155247eacfed28/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.478662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1229/2461] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:35:11.488079 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3eb8ea836847f3941b03cf554d8694, user_id=8b1c88a968dc4d1bb4155247eacfed28, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.490749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.504644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1233/2462] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:11 2022] PUT /identity/v3/projects/2a3eb8ea836847f3941b03cf554d8694/users/8b1c88a968dc4d1bb4155247eacfed28/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:11.516534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.516854 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.517128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.547115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] MFA Rules not processed for user `8b1c88a968dc4d1bb4155247eacfed28`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:11.548359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:11.581419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:11.627411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1230/2463] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:11.637820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:11.639644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:11.752662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84c02-8250-4bba-9c98-be5aeb969f2c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:11.763855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406bf6d-6114-4828-a1f2-5aa2da1560ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:11.765348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406bf6d-6114-4828-a1f2-5aa2da1560ad service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:11.765650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406bf6d-6114-4828-a1f2-5aa2da1560ad service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:11.765884 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406bf6d-6114-4828-a1f2-5aa2da1560ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:11.777144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406bf6d-6114-4828-a1f2-5aa2da1560ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:11.778881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406bf6d-6114-4828-a1f2-5aa2da1560ad service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:11.791404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1234/2464] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:12.021652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:12.089376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2267d1-3488-4358-ac4b-75d5aed9b6a3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:12.094512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:12.095182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.095484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.095756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] PATH_INFO: `/v3/users/8b1c88a968dc4d1bb4155247eacfed28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.097006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1c88a968dc4d1bb4155247eacfed28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:12.099072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:12.162056 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1c88a968dc4d1bb4155247eacfed28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.173132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1c88a968dc4d1bb4155247eacfed28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.173132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1c88a968dc4d1bb4155247eacfed28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.173132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1c88a968dc4d1bb4155247eacfed28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.180524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1c88a968dc4d1bb4155247eacfed28'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.198762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1231/2465] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:12 2022] DELETE /identity/v3/users/8b1c88a968dc4d1bb4155247eacfed28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:12.203328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.203641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.203917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.224698 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:12.225927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:12.280985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:12.292468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1235/2466] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:35:12.302682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:12.304181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:12.364608 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79f8e5-e87c-47fe-9414-ab2bacb89ae0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:12.368993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08fdbd-1fdd-438c-9d96-176d8e86dfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:12.369597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08fdbd-1fdd-438c-9d96-176d8e86dfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.369873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08fdbd-1fdd-438c-9d96-176d8e86dfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.370148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08fdbd-1fdd-438c-9d96-176d8e86dfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.376033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:12.379885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08fdbd-1fdd-438c-9d96-176d8e86dfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:12.382859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08fdbd-1fdd-438c-9d96-176d8e86dfd2 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:12.393986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1232/2467] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:12.677463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:12.678987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:12.697224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7182-a0c7-441b-9777-6412612d03cf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:12.703285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:12.704040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.704552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.704921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] PATH_INFO: `/v3/projects/2a3eb8ea836847f3941b03cf554d8694` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.706360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3eb8ea836847f3941b03cf554d8694)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:12.708404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:12.761295 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3eb8ea836847f3941b03cf554d8694', 'request_id': 'req-587d2b79-9fbb-43af-9815-d05ff2bb8b38'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.769609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3eb8ea836847f3941b03cf554d8694', 'request_id': 'req-587d2b79-9fbb-43af-9815-d05ff2bb8b38'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.776227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3eb8ea836847f3941b03cf554d8694', 'request_id': 'req-587d2b79-9fbb-43af-9815-d05ff2bb8b38'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.787573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] The token cache is being invalidate because project 2a3eb8ea836847f3941b03cf554d8694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:12.787857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.788802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-587d2b79-9fbb-43af-9815-d05ff2bb8b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:12.791464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1236/2468] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:12 2022] DELETE /identity/v3/projects/2a3eb8ea836847f3941b03cf554d8694 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:12.796310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.796679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.797051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.816921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:12.818222 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:12.880753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1233/2469] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:12.889969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.890344 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.890683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.912910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:12.914350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:12.922875 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1237/2470] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:12.927310 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:12.938337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06fed-07fc-4b1b-aca4-4a26c09bfebb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:12.943342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:12.943976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.944273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.944571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.945308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:12.945580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:12.947378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:12.960562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1234/2471] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:35:12.965617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:12.976101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55279ddc-a44b-4f50-a760-90e1349e9a1b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:12.981509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:12.982136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:12.982416 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:12.982691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:12.983322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:12.985283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.018886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1238/2472] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:12 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:13.019925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.030560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05c251-fb78-4ff0-811f-585657f6313c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.092663 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.093185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.093474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.093747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.094373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.096327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.119600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1235/2473] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:13 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:13.123836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.134761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e586-67d2-4aa8-b5b2-01e175a1e226 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.139657 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.140275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.140566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.140837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.141478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.143066 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.155420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1239/2474] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:13.159489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.169967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4575-77f6-4239-a056-b400c7740081 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.174673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694df0e-7cf7-4421-b3e5-2cf5f317a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.175274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694df0e-7cf7-4421-b3e5-2cf5f317a2de admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.175554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694df0e-7cf7-4421-b3e5-2cf5f317a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.175876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694df0e-7cf7-4421-b3e5-2cf5f317a2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.176550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694df0e-7cf7-4421-b3e5-2cf5f317a2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.178149 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694df0e-7cf7-4421-b3e5-2cf5f317a2de admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.189372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1236/2475] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:13.193739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.205168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f717337-5a74-4444-a4f9-7ca498ae3ae2 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.209774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.210437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.210718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.211988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] PATH_INFO: `/v3/projects/47794e79072d46a9ad6f15872c4f7c72/users/2f97a3c570d24b1aab05b92bd5b4e636/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.231802 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] RBAC: Authorizing `identity:create_grant(project_id=47794e79072d46a9ad6f15872c4f7c72, user_id=2f97a3c570d24b1aab05b92bd5b4e636, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.234483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.251472 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1240/2476] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:13 2022] PUT /identity/v3/projects/47794e79072d46a9ad6f15872c4f7c72/users/2f97a3c570d24b1aab05b92bd5b4e636/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:13.263468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.263761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.264043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.294311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] MFA Rules not processed for user `2f97a3c570d24b1aab05b92bd5b4e636`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:13.295534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:13.347763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:13.366726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1237/2477] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:13.371975 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.448294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6224b-767b-4827-8840-ef24c7f2ccab admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.454221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.454221 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.454706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.455074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.455911 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.457948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.487339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1241/2478] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:13 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:13.491450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.503989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196a5d7-39fc-4513-9f9e-ea3135e56f50 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.571268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.572484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.573092 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.573525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.574259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.576312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.603744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1238/2479] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:13 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:13.605043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.610670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:13.619691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae051d-aa07-4fd2-b743-3bd1218721f5 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.626172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.627132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.627517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.627900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.628687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.630419 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.643933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1242/2480] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:13.649279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.660741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df4cce-c375-4381-ad34-a6a56034cbf3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.667226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.667891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.668166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.668469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] PATH_INFO: `/v3/projects/d5686f19426d40ecb2893576d7349291/users/7e18cdc604bc4930b6fabc789112eb54/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.687464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5686f19426d40ecb2893576d7349291, user_id=7e18cdc604bc4930b6fabc789112eb54, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.690261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.724062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1239/2481] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:13 2022] PUT /identity/v3/projects/d5686f19426d40ecb2893576d7349291/users/7e18cdc604bc4930b6fabc789112eb54/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:13.725740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.736623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce34af-b7d8-431a-8785-44aba0bc9905 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.800619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad321146-4f10-4ad4-a099-638575d02a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.801235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad321146-4f10-4ad4-a099-638575d02a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.801515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad321146-4f10-4ad4-a099-638575d02a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.801811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad321146-4f10-4ad4-a099-638575d02a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.802525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad321146-4f10-4ad4-a099-638575d02a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.804112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad321146-4f10-4ad4-a099-638575d02a47 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.815753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1243/2482] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:13.820722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:13.831655 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b6c4-f7bc-4c40-8749-c1465f44cc1c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:13.838406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:13.839217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.839430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.839770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] PATH_INFO: `/v3/projects/d5686f19426d40ecb2893576d7349291/users/7e18cdc604bc4930b6fabc789112eb54/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.841782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5686f19426d40ecb2893576d7349291, user_id=7e18cdc604bc4930b6fabc789112eb54, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:13.844441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:13.856327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1240/2483] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:13 2022] PUT /identity/v3/projects/d5686f19426d40ecb2893576d7349291/users/7e18cdc604bc4930b6fabc789112eb54/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:13.868194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:13.868541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:13.868826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:13.898134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] MFA Rules not processed for user `7e18cdc604bc4930b6fabc789112eb54`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:13.899944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:13.992869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1244/2484] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:14.004188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:14.006262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:14.099376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfedb-48d8-4e65-838e-4c8495cc07e5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:14.103806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1c32f-fad7-4736-a9a2-dae4294f837d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:14.104591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c32f-fad7-4736-a9a2-dae4294f837d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:14.104995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c32f-fad7-4736-a9a2-dae4294f837d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:14.105342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c32f-fad7-4736-a9a2-dae4294f837d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:14.115214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1c32f-fad7-4736-a9a2-dae4294f837d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:14.116605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1c32f-fad7-4736-a9a2-dae4294f837d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:14.127475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1241/2485] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:14.560990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:14.623057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaa947-070d-45aa-aa3b-9d0f81b8cb28 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:14.627481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:14.628102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:14.628420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:14.628692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] PATH_INFO: `/v3/users/2f97a3c570d24b1aab05b92bd5b4e636` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:14.629795 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f97a3c570d24b1aab05b92bd5b4e636)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:14.631714 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:14.644654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:14.677446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f97a3c570d24b1aab05b92bd5b4e636'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:14.689979 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f97a3c570d24b1aab05b92bd5b4e636'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:14.697362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f97a3c570d24b1aab05b92bd5b4e636'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:14.698088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f97a3c570d24b1aab05b92bd5b4e636'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:14.705085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f97a3c570d24b1aab05b92bd5b4e636'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:14.711258 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1245/2486] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:14 2022] DELETE /identity/v3/users/2f97a3c570d24b1aab05b92bd5b4e636 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:14.716063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:14.716392 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:14.716668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:14.738036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:14.739241 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:14.760696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:14.803796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1242/2487] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:14.814205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:14.815634 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:14.871136 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837eb33-04b0-4997-aac1-81b08f435b36 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:14.874780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:14.875317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:14.875672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:14.875859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:14.885413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:14.886826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:14.896012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1246/2488] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:35:15.175811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:15.177547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:15.190646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d45885-82b4-4cf0-9f11-f1a206f4f21d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:15.195974 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:15.196809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:15.197088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:15.197360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] PATH_INFO: `/v3/projects/47794e79072d46a9ad6f15872c4f7c72` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:15.198534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47794e79072d46a9ad6f15872c4f7c72)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:15.200514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:15.252390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47794e79072d46a9ad6f15872c4f7c72', 'request_id': 'req-a6738c34-9455-4235-af80-4cfa0a30312f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.259172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47794e79072d46a9ad6f15872c4f7c72', 'request_id': 'req-a6738c34-9455-4235-af80-4cfa0a30312f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.265095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47794e79072d46a9ad6f15872c4f7c72', 'request_id': 'req-a6738c34-9455-4235-af80-4cfa0a30312f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.278509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] The token cache is being invalidate because project 47794e79072d46a9ad6f15872c4f7c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:15.278888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.279461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.281101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1243/2489] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:15 2022] DELETE /identity/v3/projects/47794e79072d46a9ad6f15872c4f7c72 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:15.285224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:15.295775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38079-91ed-4c4c-bfa9-4d8cd4aa1054 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:15.354403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:15.355033 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:15.355311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:15.355581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] PATH_INFO: `/v3/users/7e18cdc604bc4930b6fabc789112eb54` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:15.356718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e18cdc604bc4930b6fabc789112eb54)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:15.358662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:15.397287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:15.406783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e18cdc604bc4930b6fabc789112eb54'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.419794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e18cdc604bc4930b6fabc789112eb54'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.426973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e18cdc604bc4930b6fabc789112eb54'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.427614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e18cdc604bc4930b6fabc789112eb54'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.435234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c66129ed-dfd1-46d1-91e6-13d9c6686df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e18cdc604bc4930b6fabc789112eb54'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.441055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1247/2490] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:15 2022] DELETE /identity/v3/users/7e18cdc604bc4930b6fabc789112eb54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:15.709375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:15.711406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:15.731934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6738c34-9455-4235-af80-4cfa0a30312f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:15.801252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:15.801880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:15.802157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:15.802428 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] PATH_INFO: `/v3/projects/d5686f19426d40ecb2893576d7349291` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:15.803545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5686f19426d40ecb2893576d7349291)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:15.805465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:15.851060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5686f19426d40ecb2893576d7349291', 'request_id': 'req-0697f77a-6d48-4258-8c0e-1a2d284837b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.853182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:15.860229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5686f19426d40ecb2893576d7349291', 'request_id': 'req-0697f77a-6d48-4258-8c0e-1a2d284837b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.866743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5686f19426d40ecb2893576d7349291', 'request_id': 'req-0697f77a-6d48-4258-8c0e-1a2d284837b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.878563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] The token cache is being invalidate because project d5686f19426d40ecb2893576d7349291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:15.878846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.879457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0697f77a-6d48-4258-8c0e-1a2d284837b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:15.880971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1244/2491] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:15 2022] DELETE /identity/v3/projects/d5686f19426d40ecb2893576d7349291 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:15.886346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:15.886808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:15.887011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:15.906701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:15.907896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:15.967874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1248/2492] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:15.975623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:15.975917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:15.976215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:15.998613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:15.999796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:16.008474 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1245/2493] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:16.012912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.025525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1a77-e55d-41f6-b36d-5fcb0e8e58f1 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.031101 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.031708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.031984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.032269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.034553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:16.034553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.035010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.047222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1249/2494] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:16.051814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.061584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cc54a-f558-489a-826a-b7ee4c1f98bb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.066283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.066885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.067166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.067441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.068076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.070022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.099689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1246/2495] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:16 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:16.104503 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.114407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cbb7a-0882-425f-9156-76c332dc7eb8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.172616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.173218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.173493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.173773 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.174399 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.176354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.198860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1250/2496] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:16 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:16.203119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.214561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392f27-8232-4323-be40-458e08b5093d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.219184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.219715 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.219991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.220294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.220932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.222510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.232409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1247/2497] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:16.236072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.245852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dc045-a374-4b87-ac02-09b3efb60ca7 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.250395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd08a9-116e-48db-84b7-006b2cd2fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.250994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd08a9-116e-48db-84b7-006b2cd2fa28 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.251260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd08a9-116e-48db-84b7-006b2cd2fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.251528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd08a9-116e-48db-84b7-006b2cd2fa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.252163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd08a9-116e-48db-84b7-006b2cd2fa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.253764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd08a9-116e-48db-84b7-006b2cd2fa28 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.264644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1251/2498] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:16.268600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.279219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a613c-db7b-4acb-8807-05fc4a5e4631 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.283805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.284480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.284760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.285032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] PATH_INFO: `/v3/projects/2fca7f5f620c4c74bd858d05e0ca3b3a/users/90a42c92302d4da4a8d8a1a64a1420f9/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.299917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fca7f5f620c4c74bd858d05e0ca3b3a, user_id=90a42c92302d4da4a8d8a1a64a1420f9, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.302643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.315609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1248/2499] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:16 2022] PUT /identity/v3/projects/2fca7f5f620c4c74bd858d05e0ca3b3a/users/90a42c92302d4da4a8d8a1a64a1420f9/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:16.326600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.326889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.327194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.354946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] MFA Rules not processed for user `90a42c92302d4da4a8d8a1a64a1420f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:16.356151 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:16.364477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:16.433497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1252/2500] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:16.438249 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.502454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712053a-8f83-44fe-8bca-b49a3fe2f401 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.506998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.508229 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.508572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.508849 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.509465 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.511342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.537466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1249/2501] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:16 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:16.541949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.552711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95819f-25fd-4d93-b210-9595d26b78a4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.609137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.609739 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.610018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.610291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.610904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.612858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.633599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1253/2502] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:16 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:16.637615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.647858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77185d-a1d1-488f-9e8e-e9ce1edd1d68 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.653503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.654123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.654402 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.654676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.655315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.657015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.668128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1250/2503] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:16.672061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.681933 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef978f31-772d-4e68-b57a-66dbbe548768 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.686478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.687122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.687400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.687670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] PATH_INFO: `/v3/projects/ff216208750046eebd0d51dbc8063b10/users/3301171efcea463cb50669cfae55f0b6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.702664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff216208750046eebd0d51dbc8063b10, user_id=3301171efcea463cb50669cfae55f0b6, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.705326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.719140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1254/2504] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:16 2022] PUT /identity/v3/projects/ff216208750046eebd0d51dbc8063b10/users/3301171efcea463cb50669cfae55f0b6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:16.723071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.733564 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074fa3a-3c98-4c9d-ba02-93b788075efa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.779007 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:16.792009 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f1c06-1a3b-4a1f-9c45-5a91c17a653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.792647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f1c06-1a3b-4a1f-9c45-5a91c17a653d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.792927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f1c06-1a3b-4a1f-9c45-5a91c17a653d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.793196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f1c06-1a3b-4a1f-9c45-5a91c17a653d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.793830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f1c06-1a3b-4a1f-9c45-5a91c17a653d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.795409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f1c06-1a3b-4a1f-9c45-5a91c17a653d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.805469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1251/2505] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:16.809664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.819747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cb357-faed-4e41-bf48-02b6311ae241 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:16.825280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:16.825937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.826214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.826483 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] PATH_INFO: `/v3/projects/ff216208750046eebd0d51dbc8063b10/users/3301171efcea463cb50669cfae55f0b6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.828400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff216208750046eebd0d51dbc8063b10, user_id=3301171efcea463cb50669cfae55f0b6, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:16.830999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:16.841925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1255/2506] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:16 2022] PUT /identity/v3/projects/ff216208750046eebd0d51dbc8063b10/users/3301171efcea463cb50669cfae55f0b6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:16.853468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:16.853754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:16.854029 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:16.880976 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] MFA Rules not processed for user `3301171efcea463cb50669cfae55f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:16.882195 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:16.950363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1252/2507] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:16.962199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:16.963883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:17.020016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e3c9-7db8-45c6-a0f9-1616288d4f79 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:17.024266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d567-52c9-4ca3-b5a0-ac73fe087d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:17.024871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d567-52c9-4ca3-b5a0-ac73fe087d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:17.025144 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d567-52c9-4ca3-b5a0-ac73fe087d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:17.025412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d567-52c9-4ca3-b5a0-ac73fe087d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:17.034283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375d567-52c9-4ca3-b5a0-ac73fe087d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:17.035641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375d567-52c9-4ca3-b5a0-ac73fe087d76 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:17.044871 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1256/2508] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:17.073555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:17.135401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22dd64-0840-4e12-9cc1-16637d203a7e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:17.139979 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:17.140629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:17.140908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:17.141181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] PATH_INFO: `/v3/users/90a42c92302d4da4a8d8a1a64a1420f9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:17.142314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a42c92302d4da4a8d8a1a64a1420f9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:17.144208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:17.189489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a42c92302d4da4a8d8a1a64a1420f9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.196333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a42c92302d4da4a8d8a1a64a1420f9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.196958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a42c92302d4da4a8d8a1a64a1420f9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.197583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a42c92302d4da4a8d8a1a64a1420f9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.204384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a42c92302d4da4a8d8a1a64a1420f9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.212223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:17.224236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1253/2509] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:17 2022] DELETE /identity/v3/users/90a42c92302d4da4a8d8a1a64a1420f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:17.229466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:17.229749 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:17.230019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:17.237864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:17.249384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:17.250578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:17.308433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1257/2510] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:17.317890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:17.319282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:17.376451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e305-6e62-4ff0-a211-8eeb9fd4b2ff admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:17.380031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:17.380654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:17.380933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:17.381201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:17.391024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:17.392461 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:17.401930 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1254/2511] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:35:17.665877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:17.667414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:17.679125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3220a-aba4-4952-8c5b-91497eaa2fd5 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:17.684229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:17.685005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:17.685286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:17.685556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] PATH_INFO: `/v3/projects/2fca7f5f620c4c74bd858d05e0ca3b3a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:17.686659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fca7f5f620c4c74bd858d05e0ca3b3a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:17.688578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:17.735363 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fca7f5f620c4c74bd858d05e0ca3b3a', 'request_id': 'req-e78c4920-618e-4209-b64f-0690b8072188'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.743429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fca7f5f620c4c74bd858d05e0ca3b3a', 'request_id': 'req-e78c4920-618e-4209-b64f-0690b8072188'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.750916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fca7f5f620c4c74bd858d05e0ca3b3a', 'request_id': 'req-e78c4920-618e-4209-b64f-0690b8072188'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.767202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] The token cache is being invalidate because project 2fca7f5f620c4c74bd858d05e0ca3b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:17.767640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.768608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.770736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1258/2512] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:17 2022] DELETE /identity/v3/projects/2fca7f5f620c4c74bd858d05e0ca3b3a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:17.775845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:17.785774 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1cb5-49d2-44f5-9462-6bc7d08347c9 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:17.845139 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:17.845679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:17.845957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:17.846264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] PATH_INFO: `/v3/users/3301171efcea463cb50669cfae55f0b6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:17.847359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3301171efcea463cb50669cfae55f0b6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:17.849315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:17.897827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3301171efcea463cb50669cfae55f0b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.905085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3301171efcea463cb50669cfae55f0b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.905705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3301171efcea463cb50669cfae55f0b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.906348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3301171efcea463cb50669cfae55f0b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.913157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-717f8125-6b09-4455-985f-2edf98894c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3301171efcea463cb50669cfae55f0b6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:17.930280 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1255/2513] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:17 2022] DELETE /identity/v3/users/3301171efcea463cb50669cfae55f0b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:18.208088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.209558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:18.223561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4920-618e-4209-b64f-0690b8072188 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.282486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.283125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.283413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.283687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] PATH_INFO: `/v3/projects/ff216208750046eebd0d51dbc8063b10` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.284840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff216208750046eebd0d51dbc8063b10)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.286737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.321935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:18.336114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff216208750046eebd0d51dbc8063b10', 'request_id': 'req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:18.343804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff216208750046eebd0d51dbc8063b10', 'request_id': 'req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:18.349332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff216208750046eebd0d51dbc8063b10', 'request_id': 'req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:18.360863 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] The token cache is being invalidate because project ff216208750046eebd0d51dbc8063b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:18.361155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:18.361788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ce2bb836-fa2b-49e9-add6-1bd6aca35d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:18.363332 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1259/2514] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:18 2022] DELETE /identity/v3/projects/ff216208750046eebd0d51dbc8063b10 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:18.368734 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.369224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.369351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.390246 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:18.391379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:18.396703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:18.458666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1256/2515] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:18.468010 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.468326 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.468601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.488710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:18.489912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:18.498043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1260/2516] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:18.502301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.513264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47844c-39c4-4d7f-a2d6-3a8d6e94b433 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.517747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.518342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.518620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.518888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.519526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:18.519823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.521430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.533353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1257/2517] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:18.538200 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.548394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7b662-77a0-4452-974c-60ebc2fda316 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.553002 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.553595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.553870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.554138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.555475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.557390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.583991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1261/2518] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:18 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:18.588689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.598968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abf8c0-2816-4a23-8d47-506ffbb8fd7e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.654698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.655228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.655529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.655805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.656450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.658348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.679813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1258/2519] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:18 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:18.683897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.694091 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e6593-edbd-4060-8c79-b66756ab3056 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.699322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.699917 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.700202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.700538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.701215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.702803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.712977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1262/2520] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:18.716757 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.726610 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be444d-6cab-4d37-8013-fa3a2a1740a3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.731357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf95eb-2cba-4cc2-b8d6-e8486ce16f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.731943 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf95eb-2cba-4cc2-b8d6-e8486ce16f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.732221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf95eb-2cba-4cc2-b8d6-e8486ce16f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.732591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf95eb-2cba-4cc2-b8d6-e8486ce16f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.733225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf95eb-2cba-4cc2-b8d6-e8486ce16f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.734787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf95eb-2cba-4cc2-b8d6-e8486ce16f65 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.746133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1259/2521] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:18.750304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.761653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aea80-1f8b-4521-b2f8-3151d08329b8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.766430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.767107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.768202 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.768523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] PATH_INFO: `/v3/projects/57e3a89a58224f0b8fea9f66b127c49e/users/30d0f516012444219cb13c96e8ebda37/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.784599 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e3a89a58224f0b8fea9f66b127c49e, user_id=30d0f516012444219cb13c96e8ebda37, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.787280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:18.800494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1263/2522] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:18 2022] PUT /identity/v3/projects/57e3a89a58224f0b8fea9f66b127c49e/users/30d0f516012444219cb13c96e8ebda37/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:18.811977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.812324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.812601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.840965 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] MFA Rules not processed for user `30d0f516012444219cb13c96e8ebda37`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:18.842163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:18.905535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1260/2523] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:35:18.909889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:18.975423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94409f0-ee05-4e8b-9ad3-6239f207d242 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:18.980811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:18.981418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:18.981695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:18.981965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:18.982596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:18.984534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.011910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1264/2524] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:18 2022] POST /identity/v3/projects => generated 401 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:19.015973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.026746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc626c7-e92e-4e1a-b69e-90468a17717b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.030275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:19.084138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.084847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.085132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.085410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.086202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.088420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.109642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1261/2525] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:19 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:19.113718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.124573 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a189-1a68-4329-a92c-90e8c9916b45 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.129296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.129890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.130167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.130431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.131065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.132712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.143080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1265/2526] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:19.147119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.157200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188c9b-4c45-4d68-896f-4e81738cc4f4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.161673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.162315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.162591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.162865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] PATH_INFO: `/v3/projects/af15dce6293b42c9a597248757784210/users/defefb36c43443a6a1afe63316040839/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.177553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af15dce6293b42c9a597248757784210, user_id=defefb36c43443a6a1afe63316040839, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.180798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.193779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1262/2527] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:19 2022] PUT /identity/v3/projects/af15dce6293b42c9a597248757784210/users/defefb36c43443a6a1afe63316040839/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:19.198379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.208233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585e50c-9b21-44e9-9f47-f7b05b2b77cf admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.234896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:19.266697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006982a7-d0eb-4512-a3e5-c28e1297231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.267274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006982a7-d0eb-4512-a3e5-c28e1297231c admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.267549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006982a7-d0eb-4512-a3e5-c28e1297231c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.267818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006982a7-d0eb-4512-a3e5-c28e1297231c admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.268491 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006982a7-d0eb-4512-a3e5-c28e1297231c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.270049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006982a7-d0eb-4512-a3e5-c28e1297231c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.279892 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1266/2528] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:19.284039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.294775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b93a-33d3-4305-a8d1-05b575946f63 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.299341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.299981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.300292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.300567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] PATH_INFO: `/v3/projects/af15dce6293b42c9a597248757784210/users/defefb36c43443a6a1afe63316040839/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.302426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af15dce6293b42c9a597248757784210, user_id=defefb36c43443a6a1afe63316040839, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.305887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.315778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1263/2529] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:19 2022] PUT /identity/v3/projects/af15dce6293b42c9a597248757784210/users/defefb36c43443a6a1afe63316040839/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:19.326784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.327072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.327346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.355292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] MFA Rules not processed for user `defefb36c43443a6a1afe63316040839`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:19.356511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:19.421554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1267/2530] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:19.432317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.434040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:19.491650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22566ee8-ad16-4696-8836-56d2fb52aa40 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.495892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.496531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.496811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.497085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.506331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.507756 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.517025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1264/2531] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:19.593801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:19.603497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91dbfb-f009-4314-8bc8-a32d3e0a34f4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:19.607050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335d19-a008-4431-b655-126ba16da293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:19.607640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335d19-a008-4431-b655-126ba16da293 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:19.607916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335d19-a008-4431-b655-126ba16da293 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:19.608186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335d19-a008-4431-b655-126ba16da293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:19.663926 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40335d19-a008-4431-b655-126ba16da293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:19.665429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40335d19-a008-4431-b655-126ba16da293 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:19.674067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1268/2532] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:23.720307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:23.782263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72245314-36cc-4a78-b73d-e1caf7a82dc1 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:23.786869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:23.787485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:23.787764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:23.788038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] PATH_INFO: `/v3/users/30d0f516012444219cb13c96e8ebda37` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:23.789955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d0f516012444219cb13c96e8ebda37)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:23.791848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:23.794191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:23.846433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d0f516012444219cb13c96e8ebda37'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:23.858769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d0f516012444219cb13c96e8ebda37'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:23.859388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d0f516012444219cb13c96e8ebda37'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:23.860015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d0f516012444219cb13c96e8ebda37'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:23.872067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d0f516012444219cb13c96e8ebda37'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:23.890399 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1265/2533] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:23 2022] DELETE /identity/v3/users/30d0f516012444219cb13c96e8ebda37 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:23.894942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:23.895440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:23.895565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:23.915756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:23.916996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:23.958873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:23.974846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1269/2534] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:23.985873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:23.987293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:24.045438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753ead0-a7c0-4a5e-872d-4aa415b78335 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:24.049134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:24.049741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:24.050025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:24.050298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:24.060563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:24.062416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:24.072679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1266/2535] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:24.359834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:24.361278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:24.373763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a9479-a2cf-4a88-9c45-c4ce9e61a14b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:24.378642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:24.379278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:24.379558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:24.379833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] PATH_INFO: `/v3/projects/57e3a89a58224f0b8fea9f66b127c49e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:24.380973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e3a89a58224f0b8fea9f66b127c49e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:24.383551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:24.431085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e3a89a58224f0b8fea9f66b127c49e', 'request_id': 'req-7f46837a-5e31-4618-9072-fbe67dce4235'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.438345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e3a89a58224f0b8fea9f66b127c49e', 'request_id': 'req-7f46837a-5e31-4618-9072-fbe67dce4235'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.443850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e3a89a58224f0b8fea9f66b127c49e', 'request_id': 'req-7f46837a-5e31-4618-9072-fbe67dce4235'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.455176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] The token cache is being invalidate because project 57e3a89a58224f0b8fea9f66b127c49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:24.455461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.456095 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.457581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1270/2536] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:24 2022] DELETE /identity/v3/projects/57e3a89a58224f0b8fea9f66b127c49e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:24.462777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:24.472701 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a0976-a529-4d1d-a9ff-031e9e44cc99 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:24.536780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:24.537426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:24.537707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:24.537983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] PATH_INFO: `/v3/users/defefb36c43443a6a1afe63316040839` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:24.539660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defefb36c43443a6a1afe63316040839)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:24.541638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:24.569338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:24.590881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defefb36c43443a6a1afe63316040839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.597927 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defefb36c43443a6a1afe63316040839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.598581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defefb36c43443a6a1afe63316040839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.599538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defefb36c43443a6a1afe63316040839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.606238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ca0df71-0ac1-4d79-b83d-7332c299e176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defefb36c43443a6a1afe63316040839'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:24.624031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1267/2537] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:24 2022] DELETE /identity/v3/users/defefb36c43443a6a1afe63316040839 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:24.901828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:24.903316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:24.916216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46837a-5e31-4618-9072-fbe67dce4235 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:24.972726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:24.973348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:24.973624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:24.973890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] PATH_INFO: `/v3/projects/af15dce6293b42c9a597248757784210` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:24.974986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=af15dce6293b42c9a597248757784210)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:24.977511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.025805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af15dce6293b42c9a597248757784210', 'request_id': 'req-965410f9-6eed-426c-b687-ae3e56b608ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:25.033193 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af15dce6293b42c9a597248757784210', 'request_id': 'req-965410f9-6eed-426c-b687-ae3e56b608ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:25.039552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af15dce6293b42c9a597248757784210', 'request_id': 'req-965410f9-6eed-426c-b687-ae3e56b608ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:25.050389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] The token cache is being invalidate because project af15dce6293b42c9a597248757784210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:25.050676 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:25.051307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-965410f9-6eed-426c-b687-ae3e56b608ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:25.052828 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1271/2538] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:24 2022] DELETE /identity/v3/projects/af15dce6293b42c9a597248757784210 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:25.058367 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.058813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.058908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.078306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:25.079534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:25.139989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1268/2539] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:25.147873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.148519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.148519 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.156181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:25.170939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:25.172211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:25.181292 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1272/2540] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:25.185533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.195037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15444b8-0885-4076-8c28-47da896f12c6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.199594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.200185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.200495 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.200766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.201400 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:25.201705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.203276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.214875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1269/2541] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:35:25.219367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.229501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a7ece-6e8c-41e9-931f-61e5f73d1080 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.234163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.234761 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.235044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.235312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.235935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.237880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.265879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1273/2542] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:25.269990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.280000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb0898-b9da-4707-9a0e-ac76a1d3c578 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.336264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.337141 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.337421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.337693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.338315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.340216 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.362143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1270/2543] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:25.366266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.376738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6aadb-b166-4358-ac5a-83cb6fcd75b8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.381300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.381896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.382175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.382600 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.383252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.384908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.394887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1274/2544] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:25.399404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.409345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4645c-cdb8-4651-bbbd-dfdd1250d6ae admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.414547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d57a4-8430-40ee-b98f-0dbad9f19049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.415129 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d57a4-8430-40ee-b98f-0dbad9f19049 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.415408 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d57a4-8430-40ee-b98f-0dbad9f19049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.415679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d57a4-8430-40ee-b98f-0dbad9f19049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.416344 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d57a4-8430-40ee-b98f-0dbad9f19049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.417918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d57a4-8430-40ee-b98f-0dbad9f19049 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.428380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1271/2545] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:25.432499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.442297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbc74f-f7ea-4f16-8ab5-94fb791b843f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.446847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.447485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.447760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.448035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] PATH_INFO: `/v3/projects/3295e8b76cdd4eb1819e835b4f681e9e/users/af0893d395c04cb19df0843406d45ad6/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.464565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3295e8b76cdd4eb1819e835b4f681e9e, user_id=af0893d395c04cb19df0843406d45ad6, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.467281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.482173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1275/2546] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:25 2022] PUT /identity/v3/projects/3295e8b76cdd4eb1819e835b4f681e9e/users/af0893d395c04cb19df0843406d45ad6/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:25.493490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.493783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.494062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.513184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:25.525104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] MFA Rules not processed for user `af0893d395c04cb19df0843406d45ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:25.526566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:25.593634 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1272/2547] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:25.598138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.659995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec9bef-8491-4929-ab7c-758fb7ae203c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.665433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.666033 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.666314 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.666586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.667213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.669167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.695817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1276/2548] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:25.699768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.711285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97089a5-e403-4398-b544-9c9c01a77211 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.770086 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.770702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.770986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.771261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.771891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.774725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.795199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1273/2549] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:25.799260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.809517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad1a46-72dc-4c69-a0d0-a894615bf16e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.814060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.814659 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.814939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.815210 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.815850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.817484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.828631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1277/2550] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:25.832455 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.844260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da903d-14c0-48a8-a042-b214c78a5571 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.848829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5957b3d-a5c9-4898-9f1c-0a3a7e8fbb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.849456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5957b3d-a5c9-4898-9f1c-0a3a7e8fbb01 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.849738 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5957b3d-a5c9-4898-9f1c-0a3a7e8fbb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.850012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5957b3d-a5c9-4898-9f1c-0a3a7e8fbb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.850670 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5957b3d-a5c9-4898-9f1c-0a3a7e8fbb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.852290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5957b3d-a5c9-4898-9f1c-0a3a7e8fbb01 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.862040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1274/2551] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:25.865894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:25.875947 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fde7c-020e-4d34-ab50-4cf066152e4b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:25.880546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:25.881189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.881543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.881842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] PATH_INFO: `/v3/projects/587411fa574f497eb163b75ba186bcb2/users/27afd277a66d46068149a138c978626c/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.896819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] RBAC: Authorizing `identity:create_grant(project_id=587411fa574f497eb163b75ba186bcb2, user_id=27afd277a66d46068149a138c978626c, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:25.900138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:25.912411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1278/2552] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:25 2022] PUT /identity/v3/projects/587411fa574f497eb163b75ba186bcb2/users/27afd277a66d46068149a138c978626c/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:25.922619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:25.922908 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:25.923184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:25.950642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] MFA Rules not processed for user `27afd277a66d46068149a138c978626c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:25.951847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:26.020525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1275/2553] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:26.025572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.073660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:26.087774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080c23e-ac79-4aa2-9323-384c8d51dede admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.092361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.092954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.093230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.093497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.094107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.095984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.121189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1279/2554] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:26 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:26.125393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.138416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9456c0-bcd2-4a12-8425-41cc4bcd9e4d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.141484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:26.198972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.199521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.199806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.200083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.200743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.202673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.223549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1276/2555] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:26 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:26.227521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.237727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140b200-7dcb-4d3b-891a-2d2d0732ea94 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.243227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.243823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.244103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.244412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.245056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.246638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.257182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1280/2556] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:26.261992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.272471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af99529-7f05-4cbd-acbd-44f0cf11060e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.277179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.277832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.278105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.278378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] PATH_INFO: `/v3/projects/6fe4a9b45aca44c4931e55ab126f56e0/users/9de2e2122aaf4e94a567e66d789fd159/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.292969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe4a9b45aca44c4931e55ab126f56e0, user_id=9de2e2122aaf4e94a567e66d789fd159, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.295602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.309337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1277/2557] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:26 2022] PUT /identity/v3/projects/6fe4a9b45aca44c4931e55ab126f56e0/users/9de2e2122aaf4e94a567e66d789fd159/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:26.313362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.323811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8dc77-951f-44f9-b554-e5404c46eca1 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.377861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bed34-3777-4668-9657-549ca0e128f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.378460 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bed34-3777-4668-9657-549ca0e128f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.378740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bed34-3777-4668-9657-549ca0e128f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.379019 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bed34-3777-4668-9657-549ca0e128f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.379652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bed34-3777-4668-9657-549ca0e128f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.381361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bed34-3777-4668-9657-549ca0e128f3 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.391742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1281/2558] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:35:26.396054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.406554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4bc3f-5efe-4f02-b981-8e9d64e7cbfe admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.411342 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.411994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.412300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.412580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] PATH_INFO: `/v3/projects/6fe4a9b45aca44c4931e55ab126f56e0/users/9de2e2122aaf4e94a567e66d789fd159/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.414843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe4a9b45aca44c4931e55ab126f56e0, user_id=9de2e2122aaf4e94a567e66d789fd159, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.417540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.427557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1278/2559] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:26 2022] PUT /identity/v3/projects/6fe4a9b45aca44c4931e55ab126f56e0/users/9de2e2122aaf4e94a567e66d789fd159/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:26.438120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.438408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.438683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.466431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] MFA Rules not processed for user `9de2e2122aaf4e94a567e66d789fd159`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:26.467568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:26.532981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1282/2560] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:26.544961 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.546666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:26.604223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ed94-b21c-4c5c-9c88-aeff8ef66624 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.607825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.608445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.608724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.608994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.618361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.619764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.629017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1279/2561] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:26.673443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:26.674842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:26.687704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90811-f275-49eb-8e4c-8620dc7632f0 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:26.691341 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e9340-70f9-448a-a808-ecbd62d9bc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:26.691935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9340-70f9-448a-a808-ecbd62d9bc88 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:26.692217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9340-70f9-448a-a808-ecbd62d9bc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:26.692552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9340-70f9-448a-a808-ecbd62d9bc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:26.735706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:26.752502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e9340-70f9-448a-a808-ecbd62d9bc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:26.753944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e9340-70f9-448a-a808-ecbd62d9bc88 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:26.763369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1283/2562] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:29.646760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:29.708581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeb686-035c-4ca5-94b9-9c940db5a260 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:29.713482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:29.714109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:29.714390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:29.714668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] PATH_INFO: `/v3/users/af0893d395c04cb19df0843406d45ad6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:29.715783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0893d395c04cb19df0843406d45ad6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:29.717739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:29.720093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:29.766915 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0893d395c04cb19df0843406d45ad6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:29.774126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0893d395c04cb19df0843406d45ad6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:29.774740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0893d395c04cb19df0843406d45ad6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:29.775401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0893d395c04cb19df0843406d45ad6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:29.782433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0893d395c04cb19df0843406d45ad6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:29.799887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1280/2563] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:29 2022] DELETE /identity/v3/users/af0893d395c04cb19df0843406d45ad6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:29.804971 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:29.805441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:29.805560 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:29.824266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:29.825383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:29.882713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1284/2564] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:29.894847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:29.896521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:29.955405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef431b-0945-43f2-87f5-6f4136206f28 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:29.959071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:29.959678 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:29.959960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:29.960752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:29.970294 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:29.971722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:29.982124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1281/2565] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:30.256775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:30.258711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:30.271152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd80343-9f91-4b76-968a-92c26b03f680 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:30.276581 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:30.277435 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:30.277742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:30.278016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] PATH_INFO: `/v3/projects/3295e8b76cdd4eb1819e835b4f681e9e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:30.279138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3295e8b76cdd4eb1819e835b4f681e9e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:30.281096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:30.328830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3295e8b76cdd4eb1819e835b4f681e9e', 'request_id': 'req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.335858 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3295e8b76cdd4eb1819e835b4f681e9e', 'request_id': 'req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.341750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3295e8b76cdd4eb1819e835b4f681e9e', 'request_id': 'req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.353707 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] The token cache is being invalidate because project 3295e8b76cdd4eb1819e835b4f681e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:30.354291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.354945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.356465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1285/2566] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:30 2022] DELETE /identity/v3/projects/3295e8b76cdd4eb1819e835b4f681e9e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:30.360463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:30.371069 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337113e7-dc0f-4875-bde5-b596d14216e1 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:30.427640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:30.428292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:30.428576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:30.428850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] PATH_INFO: `/v3/users/27afd277a66d46068149a138c978626c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:30.430810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] RBAC: Authorizing `identity:delete_user(user_id=27afd277a66d46068149a138c978626c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:30.432763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:30.460698 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:30.480588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27afd277a66d46068149a138c978626c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.487596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27afd277a66d46068149a138c978626c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.488207 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27afd277a66d46068149a138c978626c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.488820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27afd277a66d46068149a138c978626c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.496153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27afd277a66d46068149a138c978626c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.513133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1282/2567] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:30 2022] DELETE /identity/v3/users/27afd277a66d46068149a138c978626c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:30.792545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:30.794106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:30.808535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0b17d-242c-4a3f-8eeb-4e25c7f3c68b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:30.866526 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:30.867672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:30.867950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:30.868220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] PATH_INFO: `/v3/projects/587411fa574f497eb163b75ba186bcb2` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:30.869384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587411fa574f497eb163b75ba186bcb2)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:30.871262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:30.878952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:30.918155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587411fa574f497eb163b75ba186bcb2', 'request_id': 'req-2c748864-a154-48cd-a5f7-f27907638a81'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.925259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587411fa574f497eb163b75ba186bcb2', 'request_id': 'req-2c748864-a154-48cd-a5f7-f27907638a81'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.931835 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587411fa574f497eb163b75ba186bcb2', 'request_id': 'req-2c748864-a154-48cd-a5f7-f27907638a81'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.942789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] The token cache is being invalidate because project 587411fa574f497eb163b75ba186bcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:30.943081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.943719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:30.945490 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1286/2568] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:30 2022] DELETE /identity/v3/projects/587411fa574f497eb163b75ba186bcb2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:30.949975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:30.951471 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:30.964548 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36c8ce-7d38-4f70-9933-d942a769abae admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.021331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.021983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.022247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.022521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] PATH_INFO: `/v3/users/9de2e2122aaf4e94a567e66d789fd159` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.023662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de2e2122aaf4e94a567e66d789fd159)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.025612 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.071939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de2e2122aaf4e94a567e66d789fd159'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.079104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de2e2122aaf4e94a567e66d789fd159'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.079704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de2e2122aaf4e94a567e66d789fd159'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.080316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de2e2122aaf4e94a567e66d789fd159'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.087790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8ad30a1d-055a-4d5f-abda-ece10015d119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de2e2122aaf4e94a567e66d789fd159'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.105345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1283/2569] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:30 2022] DELETE /identity/v3/users/9de2e2122aaf4e94a567e66d789fd159 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:31.401939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.403635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:31.417068 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748864-a154-48cd-a5f7-f27907638a81 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.500846 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.501665 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.502051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.502429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] PATH_INFO: `/v3/projects/6fe4a9b45aca44c4931e55ab126f56e0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.503710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe4a9b45aca44c4931e55ab126f56e0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.505759 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.558530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe4a9b45aca44c4931e55ab126f56e0', 'request_id': 'req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.566710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe4a9b45aca44c4931e55ab126f56e0', 'request_id': 'req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.572534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe4a9b45aca44c4931e55ab126f56e0', 'request_id': 'req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.583616 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] The token cache is being invalidate because project 6fe4a9b45aca44c4931e55ab126f56e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:31.583905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.584579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-ddd5b4c0-49e9-4e43-ae36-fd8bb731d660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:31.586869 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1287/2570] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:31 2022] DELETE /identity/v3/projects/6fe4a9b45aca44c4931e55ab126f56e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:31.592875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.593237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.593580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.614617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:31.615840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:31.634582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:31.678614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1284/2571] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:31.688527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.688808 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.689073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.708583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:31.709781 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:31.717996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1288/2572] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:31.722164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.732341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d3cb0-045f-48d3-9590-e3c8ba6f4d34 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.736823 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.737415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.737689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.737960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.738589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:31.738921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.740538 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.752591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1285/2573] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:31.756889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.766575 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2400-dee5-4851-b7fa-2aaf9db1e4d3 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.771216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.771807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.772425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.772706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.773843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.775777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.796615 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:31.805350 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1289/2574] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:31 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:31.810134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.820809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296665-c801-44d7-85bb-ee33640c6d1f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.886919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.887529 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.887812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.888087 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.888762 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.890812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.912545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1286/2575] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:31 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:31.917473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.927902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225e45a-a448-4c3d-9c53-8714b474b4cc admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.933484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.934028 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.934309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.934583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.935256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.936881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.946900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1290/2576] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:31.950995 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.960980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82b204-4c92-49e4-b524-0a3f4bda4900 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:31.965910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469139f5-f16f-433d-9cd6-8abe42f6b84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:31.966513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469139f5-f16f-433d-9cd6-8abe42f6b84c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:31.966792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469139f5-f16f-433d-9cd6-8abe42f6b84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:31.967067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469139f5-f16f-433d-9cd6-8abe42f6b84c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:31.967736 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469139f5-f16f-433d-9cd6-8abe42f6b84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:31.969356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469139f5-f16f-433d-9cd6-8abe42f6b84c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:31.980668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1287/2577] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:31.985404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:31.996085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83a63-56f5-4c85-b926-a8325691ff9c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:32.000582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:32.001231 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:32.001508 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:32.001777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] PATH_INFO: `/v3/projects/0cb49f2f794341e5b603a1d0f031ecc8/users/e2ef3e9a178a4c24ab301d520372be49/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:32.017322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb49f2f794341e5b603a1d0f031ecc8, user_id=e2ef3e9a178a4c24ab301d520372be49, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:32.019991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:32.032855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1291/2578] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:31 2022] PUT /identity/v3/projects/0cb49f2f794341e5b603a1d0f031ecc8/users/e2ef3e9a178a4c24ab301d520372be49/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:32.044528 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:32.044819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:32.045095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:32.073218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] MFA Rules not processed for user `e2ef3e9a178a4c24ab301d520372be49`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:32.074430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:32.137700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1288/2579] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:32.149876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:32.151535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:32.208567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937c20-b60a-4a55-ae7b-bf531e0da7fb admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:32.213256 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:32.214945 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:32.215220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:32.215496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:32.225029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:32.227124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:32.236175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1292/2580] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:38.177028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:38.178438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:38.199666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:38.240721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76a36-c48d-4fdc-b5a3-e00a69dffe87 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:38.244918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:38.245530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:38.245806 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:38.246076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:38.247848 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:38.312536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:38.313998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:38.325584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1289/2581] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:41.559509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:41.561383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:41.575913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afb529-de1a-4b98-acd7-83aeab5aeb2c service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:41.580589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:41.581191 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:41.581467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:41.581820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] PATH_INFO: `/v3/users/60612f26098a404f9d1323cc95ee6bd0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:41.582840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=60612f26098a404f9d1323cc95ee6bd0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:41.584775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:41.635340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60612f26098a404f9d1323cc95ee6bd0'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.646854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60612f26098a404f9d1323cc95ee6bd0'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.656117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60612f26098a404f9d1323cc95ee6bd0'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.656774 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60612f26098a404f9d1323cc95ee6bd0'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.664168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-662aaa9e-04e6-42a8-b663-0e80268edceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60612f26098a404f9d1323cc95ee6bd0'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.669916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1293/2582] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:41 2022] DELETE /identity/v3/users/60612f26098a404f9d1323cc95ee6bd0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:41.846708 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:41.858401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55117381-f277-48bc-ac56-720b8c757907 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:41.919183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:41.919809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:41.920085 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:41.920394 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] PATH_INFO: `/v3/projects/c12fe8b76c4342c59c9ed906f9dbed05` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:41.921496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12fe8b76c4342c59c9ed906f9dbed05)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:41.923370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:41.969478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12fe8b76c4342c59c9ed906f9dbed05', 'request_id': 'req-657373e4-d7ef-44c2-8248-cf1ce071bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.975602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12fe8b76c4342c59c9ed906f9dbed05', 'request_id': 'req-657373e4-d7ef-44c2-8248-cf1ce071bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.981372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12fe8b76c4342c59c9ed906f9dbed05', 'request_id': 'req-657373e4-d7ef-44c2-8248-cf1ce071bcea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.989744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:41.996201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] The token cache is being invalidate because project c12fe8b76c4342c59c9ed906f9dbed05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:41.996580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.997321 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-657373e4-d7ef-44c2-8248-cf1ce071bcea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:41.998892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1290/2583] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:41 2022] DELETE /identity/v3/projects/c12fe8b76c4342c59c9ed906f9dbed05 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:42.004138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.004468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.004980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.025691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:42.027037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:42.061096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:42.090563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1294/2584] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:42.099422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.099714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.099993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.120566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:42.121726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:42.129765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1291/2585] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:42.135290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.144922 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce9dbd-8b99-4892-89af-440ed6f572bc None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.150173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.150771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.151053 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.151328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.151972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:42.152303 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.153905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.169385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1295/2586] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:42.173649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.183811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe183de-a0c2-445a-a217-1c5852d2d1d1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.188508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.189106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.189388 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.189662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.190299 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.192194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.219016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1292/2587] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:42 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:42.223197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.235131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2edf-0675-424c-8aa8-52753d7e99a6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.292904 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.293536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.293840 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.294190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.294905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.297045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.322767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1296/2588] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:42 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:42.325813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.336872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ad7e6-6ce9-4429-a06e-fd26dd1699d7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.341515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.342104 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.342382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.342653 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.343326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.344954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.355238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1293/2589] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:35:42.359428 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.374367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36d5f-f983-4b11-afe3-05481dabd4bb admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.379417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49264a1a-0243-4c34-9b6c-b541ec75ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.380199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264a1a-0243-4c34-9b6c-b541ec75ce6d admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.380577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264a1a-0243-4c34-9b6c-b541ec75ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.380994 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49264a1a-0243-4c34-9b6c-b541ec75ce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.381767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49264a1a-0243-4c34-9b6c-b541ec75ce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.385747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49264a1a-0243-4c34-9b6c-b541ec75ce6d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.401388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1297/2590] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:42.410603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.421792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab18a2-5738-4cb9-a217-9c63e92815fe admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.426454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.427106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.427390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.427666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] PATH_INFO: `/v3/projects/9f84ed8f2bf34a08b9951771b426efdf/users/29fed804b1964fbba5d64fc448a75c09/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.442699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f84ed8f2bf34a08b9951771b426efdf, user_id=29fed804b1964fbba5d64fc448a75c09, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.445586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.458820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1294/2591] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:42 2022] PUT /identity/v3/projects/9f84ed8f2bf34a08b9951771b426efdf/users/29fed804b1964fbba5d64fc448a75c09/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:42.469450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.469738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.470013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.498320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] MFA Rules not processed for user `29fed804b1964fbba5d64fc448a75c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:42.499528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:42.564867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1298/2592] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:42.576132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:42.577870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:42.635273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1835a8-518f-44ca-add8-89903b087df8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:42.638838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd01540-bde3-4871-a68d-6dfd2cfcac3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:42.639437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd01540-bde3-4871-a68d-6dfd2cfcac3b service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:42.639716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd01540-bde3-4871-a68d-6dfd2cfcac3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:42.639986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd01540-bde3-4871-a68d-6dfd2cfcac3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:42.648660 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd01540-bde3-4871-a68d-6dfd2cfcac3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:42.650102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd01540-bde3-4871-a68d-6dfd2cfcac3b service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:42.658721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1295/2593] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:45.900290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:45.901807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:45.936918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:45.968981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dde94-8c29-46f4-ad5f-80ac1226aba3 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:45.973509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:45.974145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:45.974418 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:45.974691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] PATH_INFO: `/v3/users/e2ef3e9a178a4c24ab301d520372be49` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:45.975803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ef3e9a178a4c24ab301d520372be49)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:45.977965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:46.028627 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ef3e9a178a4c24ab301d520372be49'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.040653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ef3e9a178a4c24ab301d520372be49'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.048316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ef3e9a178a4c24ab301d520372be49'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.048950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ef3e9a178a4c24ab301d520372be49'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.055893 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ef3e9a178a4c24ab301d520372be49'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.061708 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1299/2594] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:45 2022] DELETE /identity/v3/users/e2ef3e9a178a4c24ab301d520372be49 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:46.068235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.068761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.068862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.089326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:46.090540 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:46.149578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1296/2595] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:35:46.159260 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:46.160720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:46.220488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9497e-0541-406d-ae50-476b9300c25f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:46.224135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7e1a-221f-4707-adf9-a7e1960bdf91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:46.224770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7e1a-221f-4707-adf9-a7e1960bdf91 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.225052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7e1a-221f-4707-adf9-a7e1960bdf91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.225325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7e1a-221f-4707-adf9-a7e1960bdf91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.234222 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7e1a-221f-4707-adf9-a7e1960bdf91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:46.235648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7e1a-221f-4707-adf9-a7e1960bdf91 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:46.245277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1300/2596] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:46.532690 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:46.534151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:46.547330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413281d3-6be0-40ae-9544-988321d323b3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:46.552187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:46.553387 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.553676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.553953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] PATH_INFO: `/v3/projects/0cb49f2f794341e5b603a1d0f031ecc8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.556457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb49f2f794341e5b603a1d0f031ecc8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:46.558953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:46.594939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:46.608751 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb49f2f794341e5b603a1d0f031ecc8', 'request_id': 'req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.614790 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb49f2f794341e5b603a1d0f031ecc8', 'request_id': 'req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.620921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb49f2f794341e5b603a1d0f031ecc8', 'request_id': 'req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.634039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] The token cache is being invalidate because project 0cb49f2f794341e5b603a1d0f031ecc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:46.634330 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.634954 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d0477e1-ce3c-4a6b-8b08-ebdfaff89e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:46.636521 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1297/2597] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:46 2022] DELETE /identity/v3/projects/0cb49f2f794341e5b603a1d0f031ecc8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:46.641402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.641692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.641997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.661552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:46.662701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:46.719829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:46.737190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1301/2598] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:46.747237 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.747526 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.747802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.767917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:46.769196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:46.778050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1298/2599] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:46.842289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:46.852621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad164b-f518-44ed-bdc1-5948ed9d45fd None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:46.857436 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:46.858050 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.858325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.858591 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.859882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:46.860185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:46.861805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:46.875318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1302/2600] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:46.879852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:46.890696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b9e78-f1e5-4363-99c9-df9e187442db None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:46.895584 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:46.899822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:46.900289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:46.900590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:46.901308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:46.903266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:46.941232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:46.944618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1299/2601] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:46 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:46.952360 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1ae18-9585-4d1e-b3fc-33296e81f2af admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:47.036497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:47.037300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:47.037642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:47.037993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:47.039378 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:47.041367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:47.067636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1303/2602] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:46 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:47.071996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:47.087159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ba675-1779-408d-a1be-11875ba8360d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:47.091820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:47.092457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:47.092739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:47.093016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:47.093693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:47.095225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:47.106783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1300/2603] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:35:47.110801 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:47.121578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364608-2c0c-478a-aed0-fb98f7e5e3a9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:47.126309 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09ef8b-2757-44c0-a705-9ff16c297397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:47.126927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09ef8b-2757-44c0-a705-9ff16c297397 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:47.127263 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09ef8b-2757-44c0-a705-9ff16c297397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:47.127540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09ef8b-2757-44c0-a705-9ff16c297397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:47.128437 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09ef8b-2757-44c0-a705-9ff16c297397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:47.130038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09ef8b-2757-44c0-a705-9ff16c297397 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:47.141322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1304/2604] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:35:47.145479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:47.156416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390a1bb-62cb-4464-bab4-ff0af43ebf17 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:47.161126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:47.161781 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:47.162065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:47.162338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] PATH_INFO: `/v3/projects/6ae6cc259c7f428285b1d00d0374e7a0/users/d8021ef7537c4ebf8a0022f1b22816d0/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:47.178031 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae6cc259c7f428285b1d00d0374e7a0, user_id=d8021ef7537c4ebf8a0022f1b22816d0, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:47.181286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:47.198967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1301/2605] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:47 2022] PUT /identity/v3/projects/6ae6cc259c7f428285b1d00d0374e7a0/users/d8021ef7537c4ebf8a0022f1b22816d0/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:47.200645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712671cf-4481-446a-8144-9a7d0b61e01b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:47.200957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712671cf-4481-446a-8144-9a7d0b61e01b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:47.201236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712671cf-4481-446a-8144-9a7d0b61e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:47.222189 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-712671cf-4481-446a-8144-9a7d0b61e01b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:47.223400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-712671cf-4481-446a-8144-9a7d0b61e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:47.283088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1305/2606] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:35:47.293877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:47.295901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:47.355875 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdd351-3178-4391-b86e-4f5ba320f6f8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:47.359853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:47.360918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:47.361211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:47.361489 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:47.372901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:47.374351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:47.386423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1302/2607] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:48.053504 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330a2e-7ee8-4194-9e11-a67b5d563abe None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:48.053963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330a2e-7ee8-4194-9e11-a67b5d563abe None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:48.054466 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330a2e-7ee8-4194-9e11-a67b5d563abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:48.083187 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-22330a2e-7ee8-4194-9e11-a67b5d563abe None None] MFA Rules not processed for user `d8021ef7537c4ebf8a0022f1b22816d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:48.084539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-22330a2e-7ee8-4194-9e11-a67b5d563abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:48.137211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:48.157791 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1306/2608] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:48.169224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:48.170682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:48.230837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f402-aa64-49dc-8868-2e943936aa54 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:48.234492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:48.235097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:48.235377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:48.235645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:48.245450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:48.246891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:48.255796 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1303/2609] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:49.606564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150cea5-8bd9-4d17-abe1-d6215cdd68e7 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:49.607070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150cea5-8bd9-4d17-abe1-d6215cdd68e7 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:49.607172 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150cea5-8bd9-4d17-abe1-d6215cdd68e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:49.625613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8150cea5-8bd9-4d17-abe1-d6215cdd68e7 None None] MFA Rules not processed for user `d8021ef7537c4ebf8a0022f1b22816d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:49.626844 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8150cea5-8bd9-4d17-abe1-d6215cdd68e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:49.634608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1307/2610] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:51.133682 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:51.135262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:51.144611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:51.152393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682c937-a615-4ec9-b6ac-f893910933b1 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:51.158306 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:51.158941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:51.159223 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:51.159498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] PATH_INFO: `/v3/users/29fed804b1964fbba5d64fc448a75c09` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:51.161067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fed804b1964fbba5d64fc448a75c09)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:51.164731 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:51.219024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fed804b1964fbba5d64fc448a75c09'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.229814 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fed804b1964fbba5d64fc448a75c09'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.230462 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fed804b1964fbba5d64fc448a75c09'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.231228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fed804b1964fbba5d64fc448a75c09'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.240368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fed804b1964fbba5d64fc448a75c09'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.273621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1304/2611] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:35:51 2022] DELETE /identity/v3/users/29fed804b1964fbba5d64fc448a75c09 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:51.274997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:51.275459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:51.275567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:51.297056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:51.298531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:51.367218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1308/2612] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:35:51.377248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:51.378780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:51.442693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eb3b5-8313-4e8c-a4dc-64ac273c4920 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:51.446958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c006ca-43a0-4c57-95f4-b7e2ac47f712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:51.447573 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c006ca-43a0-4c57-95f4-b7e2ac47f712 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:51.447867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c006ca-43a0-4c57-95f4-b7e2ac47f712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:51.448138 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c006ca-43a0-4c57-95f4-b7e2ac47f712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:51.457853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c006ca-43a0-4c57-95f4-b7e2ac47f712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:51.459298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c006ca-43a0-4c57-95f4-b7e2ac47f712 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:51.471049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1305/2613] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:51.876212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:51.877666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:51.890488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739787-19ed-488c-9bdc-c6de68deb27f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:51.895285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:51.896168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:51.896517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:51.896797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] PATH_INFO: `/v3/projects/9f84ed8f2bf34a08b9951771b426efdf` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:51.898654 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f84ed8f2bf34a08b9951771b426efdf)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:51.910640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:51.964500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f84ed8f2bf34a08b9951771b426efdf', 'request_id': 'req-a55d48e5-338e-421a-b560-8264436013f6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.972621 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f84ed8f2bf34a08b9951771b426efdf', 'request_id': 'req-a55d48e5-338e-421a-b560-8264436013f6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.979036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f84ed8f2bf34a08b9951771b426efdf', 'request_id': 'req-a55d48e5-338e-421a-b560-8264436013f6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.992787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] The token cache is being invalidate because project 9f84ed8f2bf34a08b9951771b426efdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:35:51.993080 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.993735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-a55d48e5-338e-421a-b560-8264436013f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:35:51.995473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1309/2614] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:35:51 2022] DELETE /identity/v3/projects/9f84ed8f2bf34a08b9951771b426efdf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:52.000919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.001278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.001561 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.022630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:52.023878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:52.088513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1306/2615] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:35:52.097421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.097703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.097976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.118972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:52.120163 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:52.129170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1310/2616] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:52.133981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.144275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a299-4079-496d-ac56-f7e680656347 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.149239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.149845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.150127 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.150406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.151174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:35:52.151484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.153115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.169043 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1307/2617] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:35:52.170271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.180288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1467-f109-42c0-81dd-b748be0c8b0d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.185138 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.185748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.186072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.186481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.187070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.189135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.218440 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1311/2618] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:52 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:52.222819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.230505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:52.234810 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6654-2996-47d3-be85-561ffd4571aa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.433014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.433679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.433923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.434232 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.434877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.437224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.471947 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1308/2619] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:52 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:35:52.472796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.487486 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907f9cd-9457-405a-b440-1cab40b7041a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.493166 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.493900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.494188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.494463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.495112 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.496742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.507625 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1312/2620] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:52.511948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.522498 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ce82-dddc-459a-9a9a-9eea10a5faf3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.528625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403dd44-5a49-47cb-92d0-86033349ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.530994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403dd44-5a49-47cb-92d0-86033349ff5b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.531667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403dd44-5a49-47cb-92d0-86033349ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.531951 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403dd44-5a49-47cb-92d0-86033349ff5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.532649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403dd44-5a49-47cb-92d0-86033349ff5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.535506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403dd44-5a49-47cb-92d0-86033349ff5b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.549792 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1309/2621] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:52.554473 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.568173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664be0f9-a794-4d54-9f1b-bb17f03c2d3b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.574536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.575219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.575500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.575785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] PATH_INFO: `/v3/projects/8de3e1bb24e64f69af91285232de8191/users/4944ea2717544242b43cc0d8535cb1c7/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.594329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de3e1bb24e64f69af91285232de8191, user_id=4944ea2717544242b43cc0d8535cb1c7, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.597047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.612697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1313/2622] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:52 2022] PUT /identity/v3/projects/8de3e1bb24e64f69af91285232de8191/users/4944ea2717544242b43cc0d8535cb1c7/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:52.627181 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.627542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.627903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.660413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] MFA Rules not processed for user `4944ea2717544242b43cc0d8535cb1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:52.661709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:52.762782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1310/2623] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:52.767485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.777077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:52.854867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136a12-f814-46c0-b6b3-c05cce506fa7 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.859783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.860485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.860771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.861044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.861682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.863612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:52.902373 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1314/2624] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:35:52 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:52.904060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:52.916108 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53d48f-fb4a-48f2-ac7d-09b091173aee None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:52.989370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:52.989993 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:52.990274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:52.990542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:52.991172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:52.993723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.025292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1311/2625] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:35:52 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:35:53.029393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:53.040685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e5546-19f5-4e79-a194-8d03ad3c3f5d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:53.045980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:53.046604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.046881 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.047148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.047794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:53.049430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.068710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1315/2626] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:35:53.069604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:53.075083 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:53.082438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805581e-f8f8-4267-b596-bef443ee0101 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:53.090665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:53.091340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.091618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.091892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] PATH_INFO: `/v3/projects/66b94edf45f34bb0a92cb9c330b00a23/users/ae373686225c47c8beff862c4910624e/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.111679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b94edf45f34bb0a92cb9c330b00a23, user_id=ae373686225c47c8beff862c4910624e, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:53.114337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.128235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1312/2627] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:53 2022] PUT /identity/v3/projects/66b94edf45f34bb0a92cb9c330b00a23/users/ae373686225c47c8beff862c4910624e/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:35:53.132165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:53.143957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e900-4356-4180-8181-4206ed6109d7 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:53.206243 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ddf94-b067-4e50-9b12-203e652b5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:53.208590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ddf94-b067-4e50-9b12-203e652b5b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.208880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ddf94-b067-4e50-9b12-203e652b5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.209157 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ddf94-b067-4e50-9b12-203e652b5b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.209843 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ddf94-b067-4e50-9b12-203e652b5b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:53.212770 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ddf94-b067-4e50-9b12-203e652b5b67 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.229489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1316/2628] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:35:53.233575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:53.246765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ba181-dee1-4cf1-a3bb-16f80e1ef236 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:53.252846 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:53.253534 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.253799 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.254058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] PATH_INFO: `/v3/projects/66b94edf45f34bb0a92cb9c330b00a23/users/ae373686225c47c8beff862c4910624e/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.256067 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b94edf45f34bb0a92cb9c330b00a23, user_id=ae373686225c47c8beff862c4910624e, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:53.259253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.278382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1313/2629] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:35:53 2022] PUT /identity/v3/projects/66b94edf45f34bb0a92cb9c330b00a23/users/ae373686225c47c8beff862c4910624e/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:35:53.290865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.291153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.291430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.329291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] MFA Rules not processed for user `ae373686225c47c8beff862c4910624e`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:35:53.330601 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:53.418969 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:35:53.428409 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1317/2630] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:35:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:35:53.436994 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:53.438648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:35:53.498460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af01b58-c7dd-4b00-9170-8a66cbb5c05d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:53.502240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:53.502857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.503132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.503403 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.513426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:53.514863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.525226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1314/2631] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:35:53.604015 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:35:53.613785 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7bd6-35b3-4391-b9de-32fddd99f072 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:35:53.617685 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339755c-5ceb-416a-bf3a-c1485deeca70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:35:53.618287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339755c-5ceb-416a-bf3a-c1485deeca70 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:35:53.618566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339755c-5ceb-416a-bf3a-c1485deeca70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:35:53.618838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339755c-5ceb-416a-bf3a-c1485deeca70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:35:53.677391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339755c-5ceb-416a-bf3a-c1485deeca70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:35:53.678910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339755c-5ceb-416a-bf3a-c1485deeca70 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:35:53.688783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1318/2632] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:35:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:00.483315 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:00.552527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7252531-5681-4388-92e8-08eb0f2f9e05 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:00.561377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:00.563264 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:00.563666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:00.563990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] PATH_INFO: `/v3/users/4944ea2717544242b43cc0d8535cb1c7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:00.565477 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4944ea2717544242b43cc0d8535cb1c7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:00.567621 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:00.617268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4944ea2717544242b43cc0d8535cb1c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:00.625646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4944ea2717544242b43cc0d8535cb1c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:00.626437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4944ea2717544242b43cc0d8535cb1c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:00.627052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4944ea2717544242b43cc0d8535cb1c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:00.634727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4944ea2717544242b43cc0d8535cb1c7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:00.639845 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:00.654999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1315/2633] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:00 2022] DELETE /identity/v3/users/4944ea2717544242b43cc0d8535cb1c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:00.659772 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:00.660280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:00.660470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:00.680629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:00.682612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:00.743713 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1319/2634] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:00.753937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:00.755557 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:00.841972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db21ec-8d61-46fa-93af-c6bbfa27df7a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:00.845726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:00.846329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:00.846606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:00.846872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:00.857831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:00.859276 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:00.873003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1316/2635] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:01.279417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:01.280895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:01.293479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc28b7d-ff3c-42a5-97e1-a8ea08b90cdf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:01.298060 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:01.298696 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:01.298976 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:01.299245 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] PATH_INFO: `/v3/projects/8de3e1bb24e64f69af91285232de8191` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:01.300386 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de3e1bb24e64f69af91285232de8191)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:01.302286 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:01.349860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de3e1bb24e64f69af91285232de8191', 'request_id': 'req-8e845391-c2fa-4ae8-aedb-49124cab3376'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.357913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de3e1bb24e64f69af91285232de8191', 'request_id': 'req-8e845391-c2fa-4ae8-aedb-49124cab3376'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.363366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de3e1bb24e64f69af91285232de8191', 'request_id': 'req-8e845391-c2fa-4ae8-aedb-49124cab3376'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.374747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] The token cache is being invalidate because project 8de3e1bb24e64f69af91285232de8191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:01.375034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.375670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.377185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1320/2636] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:01 2022] DELETE /identity/v3/projects/8de3e1bb24e64f69af91285232de8191 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:01.381163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:01.390741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3caf4-8273-4a24-8875-6ddd1021a700 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:01.451150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:01.451785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:01.452065 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:01.452437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] PATH_INFO: `/v3/users/ae373686225c47c8beff862c4910624e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:01.453558 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae373686225c47c8beff862c4910624e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:01.455446 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:01.502201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae373686225c47c8beff862c4910624e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.509766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae373686225c47c8beff862c4910624e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.510409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae373686225c47c8beff862c4910624e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.511022 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae373686225c47c8beff862c4910624e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.517962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7ff2bf5d-cad8-4668-83b8-48656bf8810d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae373686225c47c8beff862c4910624e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.538293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1317/2637] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:01 2022] DELETE /identity/v3/users/ae373686225c47c8beff862c4910624e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:01.816500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:01.818038 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:01.832181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e845391-c2fa-4ae8-aedb-49124cab3376 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:01.853027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:01.892400 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:01.892957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:01.893232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:01.893500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] PATH_INFO: `/v3/projects/66b94edf45f34bb0a92cb9c330b00a23` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:01.894628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b94edf45f34bb0a92cb9c330b00a23)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:01.896557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:01.941987 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b94edf45f34bb0a92cb9c330b00a23', 'request_id': 'req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.949205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b94edf45f34bb0a92cb9c330b00a23', 'request_id': 'req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.954684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b94edf45f34bb0a92cb9c330b00a23', 'request_id': 'req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.965819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] The token cache is being invalidate because project 66b94edf45f34bb0a92cb9c330b00a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:01.966100 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.966723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5fad52a0-886f-4d57-a9d0-0c0ff5e76dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:01.968164 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1321/2638] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:01 2022] DELETE /identity/v3/projects/66b94edf45f34bb0a92cb9c330b00a23 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:01.973081 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:01.973452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:01.973629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:01.994179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:01.995358 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:01.999459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:02.056996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1318/2639] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:02.064899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.065181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.065453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.085051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:02.087207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:02.095096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1322/2640] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:02.099375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.110102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986da5e4-dcad-4b06-8c7f-09de15ec4d4c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.114714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.115415 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.115576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.115843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.116522 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:02.116822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.118585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.132227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1319/2641] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:02.136756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.145908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dacc-c1f0-4ff5-b5c4-c676d2a81c7b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.151478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.152116 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.152432 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.152703 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.153330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.155216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.183161 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1323/2642] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:02.187447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.197900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf00661-28e1-452e-a8b2-9cd9af78813e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.256686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.257302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.257580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.257851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.258764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.260693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.283099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1320/2643] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:02.287176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.298027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34a0eb-508b-4c22-95af-0c69607bcfb8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.302666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.303252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.303594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.303865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.304537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.306983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.316683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1324/2644] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:02.321355 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.331134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b216-f18c-4204-94c3-e5650e136bc3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.335706 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf396b7e-62c0-4010-9447-5b7fddb868e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.336366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396b7e-62c0-4010-9447-5b7fddb868e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.336999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396b7e-62c0-4010-9447-5b7fddb868e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.337290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396b7e-62c0-4010-9447-5b7fddb868e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.337929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf396b7e-62c0-4010-9447-5b7fddb868e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.339482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf396b7e-62c0-4010-9447-5b7fddb868e2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.350137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1321/2645] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:02.354471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.364143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b373f3-de76-4ece-8b90-7ac223bb1443 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.369165 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.369797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.370074 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.370345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] PATH_INFO: `/v3/projects/4c68e84a89a24b46a3e99ccde2d92b2d/users/e09d4423d81e494b9a7c68a54d727af5/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.385617 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c68e84a89a24b46a3e99ccde2d92b2d, user_id=e09d4423d81e494b9a7c68a54d727af5, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.388233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.401912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1325/2646] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:02 2022] PUT /identity/v3/projects/4c68e84a89a24b46a3e99ccde2d92b2d/users/e09d4423d81e494b9a7c68a54d727af5/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:02.411874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.412161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.412469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.440986 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] MFA Rules not processed for user `e09d4423d81e494b9a7c68a54d727af5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:02.442221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:02.516027 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1322/2647] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:02.520547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.572076 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:02.587406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4caaa-aa21-4874-8b33-f079b2f3276e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.596219 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.596851 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.597134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.597408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.598034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.600005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.627545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1326/2648] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:02.631597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.638238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:02.642752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61486-9194-432c-bc86-842cd5d4c61b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.699475 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.699998 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.700301 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.700575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.701205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.703091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.723788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1323/2649] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:02.728660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.738903 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c243420-a7af-44ae-ad17-e66a6d8f1309 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.744149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.744786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.745061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.745329 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.745988 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.747569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.758194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1327/2650] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:02.761992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.771830 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a4fa4-11bc-4b84-9e6f-be75866e38bc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.777198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.777839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.778119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.778391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] PATH_INFO: `/v3/projects/0a5129372e6e4a00bbb5c0dc271632fd/users/7d56422ea9c247799d9b7b506f970e42/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.799014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5129372e6e4a00bbb5c0dc271632fd, user_id=7d56422ea9c247799d9b7b506f970e42, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.801705 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.815242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1324/2651] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:02 2022] PUT /identity/v3/projects/0a5129372e6e4a00bbb5c0dc271632fd/users/7d56422ea9c247799d9b7b506f970e42/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:02.820895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.834369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db609-8da5-4501-b5d7-e4821f36dc83 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.899566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe286102-f726-49f9-bb8d-4ff9921d85a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.900167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286102-f726-49f9-bb8d-4ff9921d85a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.900475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286102-f726-49f9-bb8d-4ff9921d85a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.900748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286102-f726-49f9-bb8d-4ff9921d85a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.901380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe286102-f726-49f9-bb8d-4ff9921d85a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.902953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe286102-f726-49f9-bb8d-4ff9921d85a0 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.913204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1328/2652] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:02.918038 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:02.928874 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78892-7ee5-450e-bf70-c91659cc508c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:02.933287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:02.933945 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.934221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.934491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] PATH_INFO: `/v3/projects/0a5129372e6e4a00bbb5c0dc271632fd/users/7d56422ea9c247799d9b7b506f970e42/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.936506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5129372e6e4a00bbb5c0dc271632fd, user_id=7d56422ea9c247799d9b7b506f970e42, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:02.939501 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:02.950904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1325/2653] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:02 2022] PUT /identity/v3/projects/0a5129372e6e4a00bbb5c0dc271632fd/users/7d56422ea9c247799d9b7b506f970e42/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:02.962952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:02.963240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:02.963548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:02.993556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] MFA Rules not processed for user `7d56422ea9c247799d9b7b506f970e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:02.994750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:03.060388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1329/2654] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:03.071726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:03.073504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:03.130648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96725ec3-14d9-4168-b6ed-1b0700952187 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:03.134958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9dbe1-ce7f-4810-818a-3d89d7b36124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:03.135550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9dbe1-ce7f-4810-818a-3d89d7b36124 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:03.135828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9dbe1-ce7f-4810-818a-3d89d7b36124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:03.136099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9dbe1-ce7f-4810-818a-3d89d7b36124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:03.144918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9dbe1-ce7f-4810-818a-3d89d7b36124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:03.146378 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9dbe1-ce7f-4810-818a-3d89d7b36124 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:03.156673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1326/2655] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:03.236595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:03.246334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3913b0-a9a6-4d29-a456-ef788ab16765 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:03.250043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:03.250643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:03.250921 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:03.251196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:03.295619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:03.312908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:03.314349 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:03.323339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1330/2656] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:07.505380 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c6fcc-716e-4ae4-8373-673d33d0785b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:07.505896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c6fcc-716e-4ae4-8373-673d33d0785b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:07.506017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c6fcc-716e-4ae4-8373-673d33d0785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:07.526548 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-750c6fcc-716e-4ae4-8373-673d33d0785b None None] MFA Rules not processed for user `d8021ef7537c4ebf8a0022f1b22816d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:07.527949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-750c6fcc-716e-4ae4-8373-673d33d0785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:07.586335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1327/2657] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:13.319206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=8 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:17.578894 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:18.246094 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:18.316786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6057c5-3dcb-4366-b0c3-f5b86f3b0938 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:18.323420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:18.324062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:18.324367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:18.324649 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] PATH_INFO: `/v3/users/e09d4423d81e494b9a7c68a54d727af5` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:18.325816 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09d4423d81e494b9a7c68a54d727af5)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:18.328535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:18.385182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09d4423d81e494b9a7c68a54d727af5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:18.396886 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09d4423d81e494b9a7c68a54d727af5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:18.406956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09d4423d81e494b9a7c68a54d727af5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:18.407594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09d4423d81e494b9a7c68a54d727af5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:18.415672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09d4423d81e494b9a7c68a54d727af5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:18.421605 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1331/2658] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:18 2022] DELETE /identity/v3/users/e09d4423d81e494b9a7c68a54d727af5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:18.426590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:18.426859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:18.427134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:18.446817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:18.448063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:18.509341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1328/2659] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:18.519089 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:18.520553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:18.591230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc33e64-50fe-4db7-a2d8-30e4490e8e4b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:18.597754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:18.598786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:18.599275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:18.599815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:18.621629 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:18.623533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:18.643117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1332/2660] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:19.048585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:19.052030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:19.079704 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a4e98-edda-4ca9-84c1-059d2e21252a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:19.086188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:19.087599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:19.087881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:19.088153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] PATH_INFO: `/v3/projects/4c68e84a89a24b46a3e99ccde2d92b2d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:19.089332 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c68e84a89a24b46a3e99ccde2d92b2d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:19.091546 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:19.139675 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c68e84a89a24b46a3e99ccde2d92b2d', 'request_id': 'req-3e9a4afd-2a09-4539-8576-080ebffeed56'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.146295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c68e84a89a24b46a3e99ccde2d92b2d', 'request_id': 'req-3e9a4afd-2a09-4539-8576-080ebffeed56'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.152600 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c68e84a89a24b46a3e99ccde2d92b2d', 'request_id': 'req-3e9a4afd-2a09-4539-8576-080ebffeed56'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.167111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] The token cache is being invalidate because project 4c68e84a89a24b46a3e99ccde2d92b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:19.167334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.168021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.169636 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1329/2661] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:19 2022] DELETE /identity/v3/projects/4c68e84a89a24b46a3e99ccde2d92b2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:19.174043 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:19.184901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b0ed-6e1b-41b5-bc4d-96cc3c03ba59 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:19.204345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:19.246885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:19.247631 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:19.247849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:19.248142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] PATH_INFO: `/v3/users/7d56422ea9c247799d9b7b506f970e42` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:19.249393 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d56422ea9c247799d9b7b506f970e42)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:19.251699 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:19.303479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d56422ea9c247799d9b7b506f970e42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.322990 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d56422ea9c247799d9b7b506f970e42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.333262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d56422ea9c247799d9b7b506f970e42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.334018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d56422ea9c247799d9b7b506f970e42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.342827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-20d05dbe-abf2-4c71-bad3-b75627871031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d56422ea9c247799d9b7b506f970e42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.349293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1333/2662] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:19 2022] DELETE /identity/v3/users/7d56422ea9c247799d9b7b506f970e42 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:19.632397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:19.634671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:19.650293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a4afd-2a09-4539-8576-080ebffeed56 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:19.715571 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:19.716205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:19.716512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:19.716785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] PATH_INFO: `/v3/projects/0a5129372e6e4a00bbb5c0dc271632fd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:19.717899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5129372e6e4a00bbb5c0dc271632fd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:19.719780 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:19.759532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:19.777779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5129372e6e4a00bbb5c0dc271632fd', 'request_id': 'req-8c4b8e6d-7c15-4e9a-8145-dba69351085b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.785132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5129372e6e4a00bbb5c0dc271632fd', 'request_id': 'req-8c4b8e6d-7c15-4e9a-8145-dba69351085b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.795838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5129372e6e4a00bbb5c0dc271632fd', 'request_id': 'req-8c4b8e6d-7c15-4e9a-8145-dba69351085b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.812555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] The token cache is being invalidate because project 0a5129372e6e4a00bbb5c0dc271632fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:19.812826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.813456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c4b8e6d-7c15-4e9a-8145-dba69351085b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:19.814936 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1330/2663] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:19 2022] DELETE /identity/v3/projects/0a5129372e6e4a00bbb5c0dc271632fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:19.819909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:19.820318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:19.820593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:19.841324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:19.842538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:19.908275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1334/2664] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:19.918842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:19.919154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:19.919572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:19.944843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:19.946212 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:19.954217 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1331/2665] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:19.958877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:19.974085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefbc4e-b70a-43a5-80b0-40dbc9b934b8 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:19.980991 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:19.987058 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:19.987347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:19.987624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:19.988323 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:19.988633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:19.990259 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.006895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1335/2666] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:20.011290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.020694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588976-04ea-4b84-924e-9a97ebddb34d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.026726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.027343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.027622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.027896 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.028569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.030449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.072981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1332/2667] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:20 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:20.077203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.088311 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e41a-4af4-4ccd-95c6-8b2c9ef64ec8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.116736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:20.154664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.155285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.155565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.155837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.156920 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.159081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.212583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1336/2668] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:20 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:20.217226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.231311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96807-54e1-4eef-81c5-3c850839b98e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.237202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.238225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.238778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.238778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.239591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.242203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.263231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1333/2669] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:20.274704 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.287213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a3eaf-24fa-40d4-b9f3-11d6d877c181 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.293065 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766b86d-187d-44ce-a038-86362fa85989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.293683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b86d-187d-44ce-a038-86362fa85989 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.294429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b86d-187d-44ce-a038-86362fa85989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.294429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766b86d-187d-44ce-a038-86362fa85989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.294891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766b86d-187d-44ce-a038-86362fa85989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.296536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766b86d-187d-44ce-a038-86362fa85989 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.308285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1337/2670] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:20.312438 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.322700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa3de-facd-4d25-9006-d010cea7ff42 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.327476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.328196 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.328545 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.328842 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] PATH_INFO: `/v3/projects/cd35d31cef694250847b63503b05b5ef/users/c0ed0085024041488921b517c1cf1fff/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.346253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd35d31cef694250847b63503b05b5ef, user_id=c0ed0085024041488921b517c1cf1fff, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.348941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.365389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1334/2671] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:20 2022] PUT /identity/v3/projects/cd35d31cef694250847b63503b05b5ef/users/c0ed0085024041488921b517c1cf1fff/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:20.385310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.385710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.386644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.429027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] MFA Rules not processed for user `c0ed0085024041488921b517c1cf1fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:20.430644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:20.515426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1338/2672] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:20.519921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.618590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129286b-ca93-4427-8804-c65211c0dbcc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.623393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.624001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.624309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.624597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.625228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.627113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.657411 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1335/2673] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:20 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:20.661737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.673588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c474ac-f4c6-4120-b849-b947434f7a19 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.749441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.750401 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.750522 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.750777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.751422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.753406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.804129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1339/2674] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:20 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:20.806955 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.825063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c052-95c2-467c-9fe9-e25a9250a854 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.830277 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.831048 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.831559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.831985 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.832723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.834319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.850319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1336/2675] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:20.853036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.872381 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018b31-2093-4896-bbc8-becbcd96f781 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.881527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:20.883408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:20.883799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:20.884129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] PATH_INFO: `/v3/projects/1ec69bd357a542d39f0d5e3f401c113b/users/e1544a8da356411b81a1c3fda0b0d8aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:20.909723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec69bd357a542d39f0d5e3f401c113b, user_id=e1544a8da356411b81a1c3fda0b0d8aa, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:20.913645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:20.929900 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1340/2676] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:20 2022] PUT /identity/v3/projects/1ec69bd357a542d39f0d5e3f401c113b/users/e1544a8da356411b81a1c3fda0b0d8aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:20.935172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:20.952308 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea13732-3db9-4546-9b9d-e57600d0eaaa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:20.974630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:21.025560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68907-912c-4d07-b97f-31f36a0452e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:21.026182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68907-912c-4d07-b97f-31f36a0452e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:21.026460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68907-912c-4d07-b97f-31f36a0452e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:21.026732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68907-912c-4d07-b97f-31f36a0452e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:21.027430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68907-912c-4d07-b97f-31f36a0452e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:21.029072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68907-912c-4d07-b97f-31f36a0452e6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:21.039347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1337/2677] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:21.043623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:21.049284 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:21.056738 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375618-380d-4572-9d9c-b2c54bcd0dd9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:21.061815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:21.062624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:21.064342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:21.064342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] PATH_INFO: `/v3/projects/1ec69bd357a542d39f0d5e3f401c113b/users/e1544a8da356411b81a1c3fda0b0d8aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:21.065461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec69bd357a542d39f0d5e3f401c113b, user_id=e1544a8da356411b81a1c3fda0b0d8aa, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:21.068224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:21.079894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1341/2678] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:21 2022] PUT /identity/v3/projects/1ec69bd357a542d39f0d5e3f401c113b/users/e1544a8da356411b81a1c3fda0b0d8aa/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:21.090654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:21.091185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:21.091185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:21.129710 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] MFA Rules not processed for user `e1544a8da356411b81a1c3fda0b0d8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:21.131224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:21.212419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1338/2679] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:21.223889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:21.225684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:21.288294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d127082-97b3-4a99-b924-14bdd3e03c1a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:21.292636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9566c-beab-42b6-a4b7-7132c61ef84b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:21.293238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9566c-beab-42b6-a4b7-7132c61ef84b service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:21.293518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9566c-beab-42b6-a4b7-7132c61ef84b service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:21.293788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9566c-beab-42b6-a4b7-7132c61ef84b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:21.303247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9566c-beab-42b6-a4b7-7132c61ef84b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:21.305358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9566c-beab-42b6-a4b7-7132c61ef84b service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:21.314849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1342/2680] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:21.398918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:21.410730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5428519-bdad-4a78-aa8c-b0f332a41a94 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:21.415082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:21.415687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:21.415960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:21.416227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:21.475115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:21.477598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:21.489328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1339/2681] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:26.294661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:26.295194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:26.295194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:26.326220 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:26.327444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:26.390077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1343/2682] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 17 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:26.439708 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:26.441214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:26.502969 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:26.531490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3affdcd-0612-473d-becf-35fdce6ceca1 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:26.537098 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1f0e-4816-4d39-adfe-5553ad353e76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:26.537729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1f0e-4816-4d39-adfe-5553ad353e76 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:26.538331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1f0e-4816-4d39-adfe-5553ad353e76 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:26.539592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1f0e-4816-4d39-adfe-5553ad353e76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:26.551107 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1f0e-4816-4d39-adfe-5553ad353e76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:26.552754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b1f0e-4816-4d39-adfe-5553ad353e76 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:26.562847 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1340/2683] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:36:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:36:28.767819 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:28.845907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f275dda-90a2-4014-8b11-6ceca6c4ad41 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:28.854305 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:28.855025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:28.855345 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:28.855737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] PATH_INFO: `/v3/users/c0ed0085024041488921b517c1cf1fff` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:28.857154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ed0085024041488921b517c1cf1fff)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:28.859162 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:28.924548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:28.945559 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ed0085024041488921b517c1cf1fff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:28.959865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ed0085024041488921b517c1cf1fff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:28.989908 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ed0085024041488921b517c1cf1fff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:28.990813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ed0085024041488921b517c1cf1fff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.003650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ed0085024041488921b517c1cf1fff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.012973 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1344/2684] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:28 2022] DELETE /identity/v3/users/c0ed0085024041488921b517c1cf1fff => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:29.017454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:29.017957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:29.018079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:29.039825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:29.041285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:29.111377 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1341/2685] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:29.123723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:29.125212 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:29.206571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375bba-ebae-4f37-8f22-8182e506ee12 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:29.213186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:29.213186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:29.213186 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:29.213474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:29.228030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:29.230728 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:29.244129 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1345/2686] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:29.802060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:29.804674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:29.819473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67170ad1-3723-4aaf-b55a-5605b331ad6e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:29.830707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:29.831419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:29.831719 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:29.832035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] PATH_INFO: `/v3/projects/cd35d31cef694250847b63503b05b5ef` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:29.833905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd35d31cef694250847b63503b05b5ef)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:29.841479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:29.905989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd35d31cef694250847b63503b05b5ef', 'request_id': 'req-06b96e19-ec24-4461-ae3f-b7944dc65958'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.912843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd35d31cef694250847b63503b05b5ef', 'request_id': 'req-06b96e19-ec24-4461-ae3f-b7944dc65958'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.921003 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd35d31cef694250847b63503b05b5ef', 'request_id': 'req-06b96e19-ec24-4461-ae3f-b7944dc65958'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.967625 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] The token cache is being invalidate because project cd35d31cef694250847b63503b05b5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:29.968002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.969199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:29.970924 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1342/2687] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:29 2022] DELETE /identity/v3/projects/cd35d31cef694250847b63503b05b5ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:29.974768 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:29.986936 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66e95-ed40-4b17-a125-7d31d6b8109a service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:30.065145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:30.065949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:30.066293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:30.066638 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] PATH_INFO: `/v3/users/e1544a8da356411b81a1c3fda0b0d8aa` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:30.067857 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1544a8da356411b81a1c3fda0b0d8aa)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:30.070001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:30.138561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1544a8da356411b81a1c3fda0b0d8aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.143836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:30.164909 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1544a8da356411b81a1c3fda0b0d8aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.174467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1544a8da356411b81a1c3fda0b0d8aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.175115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1544a8da356411b81a1c3fda0b0d8aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.195702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f869123-f880-4f5b-9009-f854713f80fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1544a8da356411b81a1c3fda0b0d8aa'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.204119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1346/2688] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:29 2022] DELETE /identity/v3/users/e1544a8da356411b81a1c3fda0b0d8aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:30.575891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:30.577574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:30.602258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96e19-ec24-4461-ae3f-b7944dc65958 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:30.686115 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:30.699102 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:30.699855 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:30.700211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:30.700576 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] PATH_INFO: `/v3/projects/1ec69bd357a542d39f0d5e3f401c113b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:30.701906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec69bd357a542d39f0d5e3f401c113b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:30.703899 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:30.763743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec69bd357a542d39f0d5e3f401c113b', 'request_id': 'req-183933ac-939f-4280-92d2-d8412bf13c12'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.770335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec69bd357a542d39f0d5e3f401c113b', 'request_id': 'req-183933ac-939f-4280-92d2-d8412bf13c12'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.781484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec69bd357a542d39f0d5e3f401c113b', 'request_id': 'req-183933ac-939f-4280-92d2-d8412bf13c12'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.812152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] The token cache is being invalidate because project 1ec69bd357a542d39f0d5e3f401c113b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:30.812735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.813406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-183933ac-939f-4280-92d2-d8412bf13c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:30.815215 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1343/2689] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:30 2022] DELETE /identity/v3/projects/1ec69bd357a542d39f0d5e3f401c113b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:30.822340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:30.822340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:30.822340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:30.852608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:30.854624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:30.933854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1347/2690] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:30.943017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:30.943405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:30.943802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:30.974314 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:30.977348 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:30.991328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1344/2691] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:30.996754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.008056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7367b01-e497-4316-b7c7-3d3383c9f97f None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.016197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.017006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.017443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.017694 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.018571 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:31.018938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.020722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.033485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1348/2692] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:31.039627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.054901 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ad56e-3bc8-425f-a27c-9551a6fc17bd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.062744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.063782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.064300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.064805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.065647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.068169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.122928 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1345/2693] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:31 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:31.128115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.139809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253f90-e201-4e1c-9184-16879e60fb73 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.219216 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.220001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.220392 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.220874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.221740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.224553 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.261353 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1349/2694] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:31 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:31.261982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.272338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d0033-aea2-4c6f-9d47-69905876a2ca admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.278785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.279427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.279659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.279925 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.280595 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.282202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.301379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.312304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1346/2695] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:31.314388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166bbba-4ce1-42ab-9453-3bece53d408c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.321619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96f7cc-b76e-406a-a3f5-4d1c01c97f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.326684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f7cc-b76e-406a-a3f5-4d1c01c97f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.327048 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f7cc-b76e-406a-a3f5-4d1c01c97f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.327372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f7cc-b76e-406a-a3f5-4d1c01c97f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.328230 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96f7cc-b76e-406a-a3f5-4d1c01c97f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.330394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96f7cc-b76e-406a-a3f5-4d1c01c97f17 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.343879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1350/2696] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:31.348991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.360432 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6560d-39b7-41aa-8b64-f451a9bba9ea admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.365385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.366109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.368390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.368856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] PATH_INFO: `/v3/projects/beecaac338624c4bb0a14f1da62a1cfc/users/0cf159780faa4369ab719c1ab81dd226/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.393298 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=beecaac338624c4bb0a14f1da62a1cfc, user_id=0cf159780faa4369ab719c1ab81dd226, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.396990 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.427643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1347/2697] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:31 2022] PUT /identity/v3/projects/beecaac338624c4bb0a14f1da62a1cfc/users/0cf159780faa4369ab719c1ab81dd226/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:31.429986 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.430173 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.430410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.484891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] MFA Rules not processed for user `0cf159780faa4369ab719c1ab81dd226`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:31.487025 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:31.533273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:31.617120 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1351/2698] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:36:31.618597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.699269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7976a0-55a3-4b70-8a4a-83fabf205c6b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.704967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.705764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.706221 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.706618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.707694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.710016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.738820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:31.747826 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1348/2699] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:31 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:31.751878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.764807 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a470cb-6f8c-4acd-9fe1-693775e0c18d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.835376 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.836794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.837530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.837813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.838456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.840496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.865196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1352/2700] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:31 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:31.870633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.883467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729a7c-dee4-4323-89dc-7062c36d5f48 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.890481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.891347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.891469 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.891782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.892581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.894447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.911255 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1349/2701] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:31.913027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.925653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac18122-223d-4c98-899a-1f1cb5fd3629 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:31.931710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:31.932723 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:31.933081 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:31.933425 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] PATH_INFO: `/v3/projects/6b5d37877b0e46ff9e1d7a711ba7a10f/users/078f97c804a24faf8edc9b81f96fbe24/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:31.953564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5d37877b0e46ff9e1d7a711ba7a10f, user_id=078f97c804a24faf8edc9b81f96fbe24, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:31.957493 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:31.973361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1353/2702] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:31 2022] PUT /identity/v3/projects/6b5d37877b0e46ff9e1d7a711ba7a10f/users/078f97c804a24faf8edc9b81f96fbe24/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:31.981827 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:31.994996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab1efc-6ff1-4539-b30a-5eea9f24d511 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:32.093774 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768ce8c-c08f-435c-ad90-36719007cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:32.094834 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768ce8c-c08f-435c-ad90-36719007cba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:32.095292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768ce8c-c08f-435c-ad90-36719007cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:32.095515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768ce8c-c08f-435c-ad90-36719007cba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:32.096582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768ce8c-c08f-435c-ad90-36719007cba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:32.099421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768ce8c-c08f-435c-ad90-36719007cba8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:32.123777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1350/2703] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:32.125398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:32.141313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d70f-f5b4-457e-a1ec-63663cfc017b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:32.148970 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:32.149798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:32.150205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:32.150477 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] PATH_INFO: `/v3/projects/6b5d37877b0e46ff9e1d7a711ba7a10f/users/078f97c804a24faf8edc9b81f96fbe24/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:32.153237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5d37877b0e46ff9e1d7a711ba7a10f, user_id=078f97c804a24faf8edc9b81f96fbe24, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:32.156883 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:32.171092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1354/2704] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:32 2022] PUT /identity/v3/projects/6b5d37877b0e46ff9e1d7a711ba7a10f/users/078f97c804a24faf8edc9b81f96fbe24/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:32.182604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:32.183070 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:32.183441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:32.220481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] MFA Rules not processed for user `078f97c804a24faf8edc9b81f96fbe24`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:32.221906 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:32.303582 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1351/2705] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:32.315296 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:32.317639 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:32.391558 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f156a3-2643-44a3-a527-78005adf0a11 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:32.396850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:32.398549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:32.398951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:32.399362 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:32.411214 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:32.412683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:32.426661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1355/2706] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:34.091579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:34.093166 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:34.169880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24bef3-8435-4417-bc4d-b83180b824b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:34.175257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:34.176456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:34.176776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:34.177163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:34.179703 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:34.203619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:34.219492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:34.234059 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:34.290806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca9975-0fec-4f33-9566-4d74e9f526b3 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:34.292405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:34.294263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de2cc-8067-4d61-8b7c-fe7ffdb02881 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:34.296833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:34.297782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:34.298281 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:34.298907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] PATH_INFO: `/v3/users/0cf159780faa4369ab719c1ab81dd226` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:34.300265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf159780faa4369ab719c1ab81dd226)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:34.302636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:34.306627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1352/2707] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:34.363764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf159780faa4369ab719c1ab81dd226'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:34.389918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf159780faa4369ab719c1ab81dd226'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:34.399929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf159780faa4369ab719c1ab81dd226'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:34.401643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf159780faa4369ab719c1ab81dd226'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:34.415544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf159780faa4369ab719c1ab81dd226'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:34.425016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1356/2708] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:34 2022] DELETE /identity/v3/users/0cf159780faa4369ab719c1ab81dd226 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:34.430374 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:34.430900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:34.431178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:34.454422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:34.455640 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:34.546658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1353/2709] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:34.557726 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:34.560275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:34.629063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb6a5-296a-46c6-9ef6-80618e9b770f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:34.633822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:34.634442 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:34.634722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:34.634993 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:34.646308 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:34.648338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:34.659525 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1357/2710] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:34.990194 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:34.992819 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:35.016072 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1583-3f40-4da7-bfb4-1684106d069c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:35.021570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:35.022531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:35.023151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:35.024160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] PATH_INFO: `/v3/projects/beecaac338624c4bb0a14f1da62a1cfc` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:35.035569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] RBAC: Authorizing `identity:delete_project(project_id=beecaac338624c4bb0a14f1da62a1cfc)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:35.038431 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:35.108101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beecaac338624c4bb0a14f1da62a1cfc', 'request_id': 'req-2d193c89-b1ea-4850-b74e-546550c1741d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.115766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beecaac338624c4bb0a14f1da62a1cfc', 'request_id': 'req-2d193c89-b1ea-4850-b74e-546550c1741d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.123125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beecaac338624c4bb0a14f1da62a1cfc', 'request_id': 'req-2d193c89-b1ea-4850-b74e-546550c1741d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.140062 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] The token cache is being invalidate because project beecaac338624c4bb0a14f1da62a1cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:35.140642 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.141296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.143782 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1354/2711] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:34 2022] DELETE /identity/v3/projects/beecaac338624c4bb0a14f1da62a1cfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:35.147832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:35.157887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c752db0-101d-4166-ac30-18316e7871f8 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:35.219414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:35.249951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:35.250596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:35.250878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:35.251148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] PATH_INFO: `/v3/users/078f97c804a24faf8edc9b81f96fbe24` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:35.252328 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078f97c804a24faf8edc9b81f96fbe24)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:35.254509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:35.328932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078f97c804a24faf8edc9b81f96fbe24'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.345545 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078f97c804a24faf8edc9b81f96fbe24'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.356709 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078f97c804a24faf8edc9b81f96fbe24'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.357430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078f97c804a24faf8edc9b81f96fbe24'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.367209 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-8aea3a13-8e61-47ce-ae73-b8b90bccaf26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078f97c804a24faf8edc9b81f96fbe24'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:35.374628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1358/2712] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:35 2022] DELETE /identity/v3/users/078f97c804a24faf8edc9b81f96fbe24 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:35.833730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:35.836657 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:35.854996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d193c89-b1ea-4850-b74e-546550c1741d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:35.924524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:35.961373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:35.962164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:35.962452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:35.962730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] PATH_INFO: `/v3/projects/6b5d37877b0e46ff9e1d7a711ba7a10f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:35.963884 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5d37877b0e46ff9e1d7a711ba7a10f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:35.965939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.037307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5d37877b0e46ff9e1d7a711ba7a10f', 'request_id': 'req-c16249cb-75b5-4a85-9ca5-b05a1e75c268'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:36.045652 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5d37877b0e46ff9e1d7a711ba7a10f', 'request_id': 'req-c16249cb-75b5-4a85-9ca5-b05a1e75c268'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:36.052208 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5d37877b0e46ff9e1d7a711ba7a10f', 'request_id': 'req-c16249cb-75b5-4a85-9ca5-b05a1e75c268'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:36.070687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] The token cache is being invalidate because project 6b5d37877b0e46ff9e1d7a711ba7a10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:36.070972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:36.072648 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c16249cb-75b5-4a85-9ca5-b05a1e75c268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:36.075145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1355/2713] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:35 2022] DELETE /identity/v3/projects/6b5d37877b0e46ff9e1d7a711ba7a10f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:36.080090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.080741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.080741 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.114524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:36.116011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:36.203506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1359/2714] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:36.208939 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.209503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.209503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.238476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:36.239727 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:36.254506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1356/2715] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:36.259009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:36.270942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a953d8-91b3-4e2e-8303-2f76f7949c99 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:36.278824 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:36.279459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.280794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.280794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.281029 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:36.281240 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:36.284684 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.320293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1360/2716] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:36.324620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:36.338261 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c183f-2c92-4a3e-bbca-800f3f4ab681 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:36.356422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:36.357058 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.357339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.357609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.358254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:36.360136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.417570 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1357/2717] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:36 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:36.422312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:36.447944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c77b-2774-42b0-818c-34619fa94924 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:36.510433 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:36.526914 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:36.527792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.528380 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.529777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.530731 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:36.533502 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.575237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1361/2718] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:36 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:36.581749 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:36.599585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313df38-547a-4d34-894a-fcdf126214b2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:36.612346 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:36.613145 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.613550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.613841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.614493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:36.622503 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.658010 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1358/2719] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:36.664870 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:36.677313 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcd0b7-b365-4f96-9574-bfef54a548c2 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:36.686287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc28780-1d7c-4909-8aed-3a1a7270cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:36.686948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28780-1d7c-4909-8aed-3a1a7270cb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.687932 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28780-1d7c-4909-8aed-3a1a7270cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.688199 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28780-1d7c-4909-8aed-3a1a7270cb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.688902 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc28780-1d7c-4909-8aed-3a1a7270cb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:36.690539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc28780-1d7c-4909-8aed-3a1a7270cb31 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.705614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1362/2720] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:36.710051 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:36.723201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd80f-fba0-43d4-998e-b8d806f0da26 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:36.732714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:36.733579 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.733966 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.734345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] PATH_INFO: `/v3/projects/b7c5c25995ac4fd88dea86963bf86c95/users/716560222abc4f97acf38d9f6067ba1d/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.761499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c5c25995ac4fd88dea86963bf86c95, user_id=716560222abc4f97acf38d9f6067ba1d, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:36.764824 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:36.793084 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1359/2721] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:36 2022] PUT /identity/v3/projects/b7c5c25995ac4fd88dea86963bf86c95/users/716560222abc4f97acf38d9f6067ba1d/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:36.863140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:36.863595 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:36.863984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:36.908814 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] MFA Rules not processed for user `716560222abc4f97acf38d9f6067ba1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:36.912594 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:37.092856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1363/2722] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:37.097419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.196296 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610cbbe-0254-429e-b057-caed74fdf9d6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:37.202035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:37.202807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.203193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.203572 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.204350 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:37.206435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:37.224764 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:37.244398 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1360/2723] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:37.246597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.259642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1fb8-00f5-4286-8a9a-d811ab919585 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:37.332007 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:37.332661 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.332937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.333205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.333841 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:37.336608 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:37.370905 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1364/2724] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:37 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:37.374853 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.388159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5779-bb6d-442a-bb84-79407d27c294 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:37.392887 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:37.393580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.393932 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.394279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.395012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:37.397811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:37.414184 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1361/2725] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:37.415454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.428725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4468a-d536-4935-b66d-d6a53f85202b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:37.441423 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:37.442379 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.442782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.443156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] PATH_INFO: `/v3/projects/3c30eca3e0734b3f9602b1ffe60d4699/users/d948fcb2662040ca88b7ad96443088c6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.469082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c30eca3e0734b3f9602b1ffe60d4699, user_id=d948fcb2662040ca88b7ad96443088c6, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:37.473218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:37.505156 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1365/2726] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:37 2022] PUT /identity/v3/projects/3c30eca3e0734b3f9602b1ffe60d4699/users/d948fcb2662040ca88b7ad96443088c6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:37.509395 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.524059 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c8083-67da-46cd-aaa4-b3f3deb8c843 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:37.661091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f3c2-afcd-40f3-a918-c5350b5f881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:37.661709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f3c2-afcd-40f3-a918-c5350b5f881b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.661987 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f3c2-afcd-40f3-a918-c5350b5f881b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.662268 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f3c2-afcd-40f3-a918-c5350b5f881b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.662946 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f3c2-afcd-40f3-a918-c5350b5f881b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:37.664904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f3c2-afcd-40f3-a918-c5350b5f881b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:37.680967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1362/2727] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:37.682335 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.695747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0805a0-1c61-4b97-9429-de8076cc9ad9 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:37.701176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:37.701927 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.702290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.702635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] PATH_INFO: `/v3/projects/3c30eca3e0734b3f9602b1ffe60d4699/users/d948fcb2662040ca88b7ad96443088c6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.704826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c30eca3e0734b3f9602b1ffe60d4699, user_id=d948fcb2662040ca88b7ad96443088c6, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:37.707643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:37.732918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:37.732918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:37.732918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:37.747827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1366/2728] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:37 2022] PUT /identity/v3/projects/3c30eca3e0734b3f9602b1ffe60d4699/users/d948fcb2662040ca88b7ad96443088c6/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:37.789843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] MFA Rules not processed for user `d948fcb2662040ca88b7ad96443088c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:37.791150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:37.902702 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1363/2729] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:37.910273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:37.912775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:37.951146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:38.059044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5237c-ae79-47c0-baaf-bf46f9f7428a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:38.064265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:38.065550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:38.066085 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:38.066572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:38.080747 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:38.084725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:38.103810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1367/2730] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:38.613100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:38.614549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:38.731500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fec4-9eef-4625-ab67-310c7dc12f32 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:38.736370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:38.737236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:38.737677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:38.738240 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] PATH_INFO: `/v3/users/753c77f1591342c9936f104b2c7833fc` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:38.741962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753c77f1591342c9936f104b2c7833fc)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:38.744815 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:38.753578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:38.809942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753c77f1591342c9936f104b2c7833fc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:38.820689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753c77f1591342c9936f104b2c7833fc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:38.821227 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753c77f1591342c9936f104b2c7833fc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:38.821881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753c77f1591342c9936f104b2c7833fc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:38.830862 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753c77f1591342c9936f104b2c7833fc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:38.856304 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1364/2731] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:38 2022] DELETE /identity/v3/users/753c77f1591342c9936f104b2c7833fc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:38.973067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:38.990331 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb63fa-c7c7-4365-8e60-39e0f16a699e service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.065771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.066518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.066877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.067226 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] PATH_INFO: `/v3/users/716560222abc4f97acf38d9f6067ba1d` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.068489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716560222abc4f97acf38d9f6067ba1d)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.071273 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.117858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.119589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.143973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb63a2-5801-4542-8e2b-4e4b72b5a464 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.150981 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.151723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.151905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.152186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] PATH_INFO: `/v3/projects/b2a788df85eb4ab7aa07282dab1f5b4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.153364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a788df85eb4ab7aa07282dab1f5b4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.154062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716560222abc4f97acf38d9f6067ba1d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.155281 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.179836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716560222abc4f97acf38d9f6067ba1d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.193561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716560222abc4f97acf38d9f6067ba1d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.197142 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716560222abc4f97acf38d9f6067ba1d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.223027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-22963efd-c1ac-46c3-9365-d1e91d9ee689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716560222abc4f97acf38d9f6067ba1d'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.226096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a788df85eb4ab7aa07282dab1f5b4b', 'request_id': 'req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.234018 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a788df85eb4ab7aa07282dab1f5b4b', 'request_id': 'req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.237992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1368/2732] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:38 2022] DELETE /identity/v3/users/716560222abc4f97acf38d9f6067ba1d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:39.240796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.241062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.241356 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.248839 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a788df85eb4ab7aa07282dab1f5b4b', 'request_id': 'req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.273121 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] The token cache is being invalidate because project b2a788df85eb4ab7aa07282dab1f5b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:39.273419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.275013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9ed12b83-f002-4fc4-8b0d-6b760e5816cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:39.276785 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1365/2733] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:39 2022] DELETE /identity/v3/projects/b2a788df85eb4ab7aa07282dab1f5b4b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:39.281509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6813132-f740-4b33-abba-63919e8efba8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.281818 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6813132-f740-4b33-abba-63919e8efba8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.282068 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6813132-f740-4b33-abba-63919e8efba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.289497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:39.291207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.305143 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e6813132-f740-4b33-abba-63919e8efba8 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:39.306505 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e6813132-f740-4b33-abba-63919e8efba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.333375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:39.380732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1369/2734] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:39.387856 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1366/2735] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:39.389340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.389627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.389910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.390954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.392359 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.414850 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:39.416414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.424840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1367/2736] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:39.429251 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.433963 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:39.440091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c177f-6c66-4d11-80b8-551d3c49ea05 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.447890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.448919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.449616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.449982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.450626 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:39.451136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.453113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.468812 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1368/2737] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:39.473271 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.476540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748438a-cca9-414b-a7f0-7ed708b099f9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.480540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.480865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.481149 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.481430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.484370 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954b953-9170-49d9-8b93-83e05787669f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.489873 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.490466 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.490743 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.491609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.492270 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.494256 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.495499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.497832 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.511338 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1370/2738] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:39.527720 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1369/2739] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:39 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:39.531890 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.546827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ede9f-7faa-4047-9c83-8aacb2118d09 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.637412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.638124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.638565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.638891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.639712 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.642208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.669842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1371/2740] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:39 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:39.673798 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.687910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390bf5-7834-4474-84d2-e56993d65a8f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.696113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.697460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.698219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.699419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.700099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.703354 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.719343 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1370/2741] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:39.720610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.736012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ebf7d-2cdc-4cfb-a5d4-e0b876cd3735 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.749732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f463d7-8173-4091-b9c4-4f7e11aea579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.750567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f463d7-8173-4091-b9c4-4f7e11aea579 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.751088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f463d7-8173-4091-b9c4-4f7e11aea579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.751461 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f463d7-8173-4091-b9c4-4f7e11aea579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.752407 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f463d7-8173-4091-b9c4-4f7e11aea579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.756679 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f463d7-8173-4091-b9c4-4f7e11aea579 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.774137 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1372/2742] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:39.778390 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.793180 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07bea-0067-4aa0-8514-58f81b1bac7d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:39.798672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:39.799758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.800037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.800352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] PATH_INFO: `/v3/projects/36506faced3b4e5e865cc25a5d4aaf95/users/a3046c64fca242d58e17e3d334ddb6ff/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.819870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36506faced3b4e5e865cc25a5d4aaf95, user_id=a3046c64fca242d58e17e3d334ddb6ff, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:39.823341 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:39.840293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1371/2743] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:39 2022] PUT /identity/v3/projects/36506faced3b4e5e865cc25a5d4aaf95/users/a3046c64fca242d58e17e3d334ddb6ff/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:39.849710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:39.850009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:39.850438 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:39.888898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] MFA Rules not processed for user `a3046c64fca242d58e17e3d334ddb6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:39.892459 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.913996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:39.917637 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:39.977680 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:40.015317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1373/2744] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:40.027421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:40.029421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:40.044147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8dd72-c1c9-43fb-9730-0e2ea0617ed1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:40.049912 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:40.050723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:40.051159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:40.051603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] PATH_INFO: `/v3/projects/b7c5c25995ac4fd88dea86963bf86c95` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:40.054091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c5c25995ac4fd88dea86963bf86c95)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:40.057189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:40.123190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d8aa-6fcf-451a-9fb0-029622a944fe None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:40.125313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c5c25995ac4fd88dea86963bf86c95', 'request_id': 'req-f18e84ad-9ac2-4c87-9cae-cd00820879bd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.134686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c5c25995ac4fd88dea86963bf86c95', 'request_id': 'req-f18e84ad-9ac2-4c87-9cae-cd00820879bd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.143136 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c5c25995ac4fd88dea86963bf86c95', 'request_id': 'req-f18e84ad-9ac2-4c87-9cae-cd00820879bd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.162152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] The token cache is being invalidate because project b7c5c25995ac4fd88dea86963bf86c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:40.163892 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.164983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.170372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1372/2745] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:39 2022] DELETE /identity/v3/projects/b7c5c25995ac4fd88dea86963bf86c95 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:40.171313 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:40.173060 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:40.207966 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:40.209034 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:40.209642 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:40.210322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:40.213729 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:40.214849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:40.278410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e84ad-9ac2-4c87-9cae-cd00820879bd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:40.283273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:40.283914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:40.284190 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:40.284491 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] PATH_INFO: `/v3/users/d948fcb2662040ca88b7ad96443088c6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:40.285747 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d948fcb2662040ca88b7ad96443088c6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:40.287525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:40.308470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:40.311364 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:40.325656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1374/2746] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:40.357793 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:40.360389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:40.363728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd948fcb2662040ca88b7ad96443088c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.376482 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd948fcb2662040ca88b7ad96443088c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.378410 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd948fcb2662040ca88b7ad96443088c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.379768 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd948fcb2662040ca88b7ad96443088c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.393096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd948fcb2662040ca88b7ad96443088c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:40.401540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:40.430562 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1373/2747] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:40 2022] DELETE /identity/v3/users/d948fcb2662040ca88b7ad96443088c6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:40.491695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c02311-078f-47fe-8e0a-2f5cdb1fd9d2 service nova] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:40.604756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:40.605855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:40.606475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:40.606645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:40.609985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:40.734565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:40.743898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:40.757252 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1375/2748] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:40.980490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:40.982026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:41.153481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850133b4-61e5-4606-9710-35dc533c9163 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.158537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.159173 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.159449 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.159721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] PATH_INFO: `/v3/projects/3c30eca3e0734b3f9602b1ffe60d4699` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.162409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c30eca3e0734b3f9602b1ffe60d4699)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.165420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.248117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:41.256052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.256722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c30eca3e0734b3f9602b1ffe60d4699', 'request_id': 'req-109e8516-1632-41c1-858b-e761074a7a26'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:41.257732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:41.271061 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a6a0-73ad-442d-98ed-393dad945a5d service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.271632 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c30eca3e0734b3f9602b1ffe60d4699', 'request_id': 'req-109e8516-1632-41c1-858b-e761074a7a26'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:41.284843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c30eca3e0734b3f9602b1ffe60d4699', 'request_id': 'req-109e8516-1632-41c1-858b-e761074a7a26'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:41.305566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] The token cache is being invalidate because project 3c30eca3e0734b3f9602b1ffe60d4699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:41.308162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:41.310586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-109e8516-1632-41c1-858b-e761074a7a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:41.317837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1374/2749] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:40 2022] DELETE /identity/v3/projects/3c30eca3e0734b3f9602b1ffe60d4699 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:41.319405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f3261-fc00-476d-b256-c6d816f71498 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.319644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f3261-fc00-476d-b256-c6d816f71498 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.319923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f3261-fc00-476d-b256-c6d816f71498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.348516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f83f3261-fc00-476d-b256-c6d816f71498 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:41.349755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f83f3261-fc00-476d-b256-c6d816f71498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:41.350070 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.351501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.351769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.352153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.353885 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:41.400837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:41.437552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1375/2750] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:41.447880 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.448171 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.448525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.452760 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.454317 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.468834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1376/2751] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:41.474470 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:41.476192 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:41.484552 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1376/2752] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:41.488767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.499813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b094c2-bc43-4498-8e54-bc0cbbb06710 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.504669 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.505280 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.505562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.505837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.507196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:41.507480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.508978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.527563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1377/2753] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:41.531811 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.543036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74538-09b5-49c8-ae30-13cb9e4252cb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.548686 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.549269 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.549550 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.549825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.550463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.552424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.593616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1377/2754] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:41 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:41.594867 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.606213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc48b-ac25-43cd-898e-3dbad385d67b admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.670257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.670985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.671367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.671742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.672507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.674544 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.703794 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1378/2755] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:41 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:41.707684 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.724420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e6db-19f5-477b-889b-8733e2c85e71 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.731055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.732152 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.732418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.732859 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.733718 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.735771 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.751430 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1378/2756] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:41.755478 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.767324 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24b287-b59b-4d99-b64a-90c32508e061 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.772434 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c84bb1-2647-44c0-a55b-146112cb80ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.773415 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c84bb1-2647-44c0-a55b-146112cb80ae admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.773787 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c84bb1-2647-44c0-a55b-146112cb80ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.774168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c84bb1-2647-44c0-a55b-146112cb80ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.774963 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c84bb1-2647-44c0-a55b-146112cb80ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.776719 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c84bb1-2647-44c0-a55b-146112cb80ae admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.791462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1379/2757] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:41.792739 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:41.804858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e60fa-6e63-4862-82cb-a7b6cf550c6e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:41.809973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:41.810633 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.810914 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.811189 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] PATH_INFO: `/v3/projects/4fa5de6e95884f7b816bea0733a17b19/users/6df2c3b84e4543a79efff7189704bcf5/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.830934 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa5de6e95884f7b816bea0733a17b19, user_id=6df2c3b84e4543a79efff7189704bcf5, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:41.833956 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:41.855386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1379/2758] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:41 2022] PUT /identity/v3/projects/4fa5de6e95884f7b816bea0733a17b19/users/6df2c3b84e4543a79efff7189704bcf5/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:41.866506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:41.866849 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:41.867732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:41.897592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] MFA Rules not processed for user `6df2c3b84e4543a79efff7189704bcf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:41.899134 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:41.992623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1380/2759] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:42.004514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:42.008347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:42.077957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6120ab-c6a9-4c34-a62b-518a3bffd100 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:42.082419 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68310a8f-04b1-443d-8b63-9250588ab1a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:42.083146 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68310a8f-04b1-443d-8b63-9250588ab1a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:42.083567 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68310a8f-04b1-443d-8b63-9250588ab1a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:42.083807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68310a8f-04b1-443d-8b63-9250588ab1a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:42.094616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68310a8f-04b1-443d-8b63-9250588ab1a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:42.096169 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68310a8f-04b1-443d-8b63-9250588ab1a5 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:42.106231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1380/2760] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:42.127547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:42.141687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:42.202736 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5833fab-e921-4bef-b7f3-3321f357b778 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:42.208234 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:42.208873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:42.209148 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:42.209458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] PATH_INFO: `/v3/users/6df2c3b84e4543a79efff7189704bcf5` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:42.210632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df2c3b84e4543a79efff7189704bcf5)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:42.212834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:42.266551 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df2c3b84e4543a79efff7189704bcf5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:42.279294 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df2c3b84e4543a79efff7189704bcf5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:42.289489 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df2c3b84e4543a79efff7189704bcf5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:42.290270 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df2c3b84e4543a79efff7189704bcf5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:42.298512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df2c3b84e4543a79efff7189704bcf5'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:42.306980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1381/2761] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:42 2022] DELETE /identity/v3/users/6df2c3b84e4543a79efff7189704bcf5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:42.311496 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:42.311778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:42.312050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:42.331967 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:42.333218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:42.338878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:42.405414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1381/2762] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:36:42.418775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:42.421358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:42.488910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3d63-0f88-4828-b39f-9e053fa40190 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:42.493777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:42.494389 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:42.494666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:42.494937 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:42.504562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:42.505992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:42.516293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1382/2763] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:42.900948 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:42.902618 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:42.933036 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a460-8197-4329-9bfd-c298c0e088f4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:42.940318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:42.941099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:42.941490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:42.942285 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] PATH_INFO: `/v3/projects/4fa5de6e95884f7b816bea0733a17b19` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:42.943247 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa5de6e95884f7b816bea0733a17b19)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:42.945761 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:43.014209 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa5de6e95884f7b816bea0733a17b19', 'request_id': 'req-be5619a2-06f3-4b03-983f-cf7e487816bc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:43.021203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa5de6e95884f7b816bea0733a17b19', 'request_id': 'req-be5619a2-06f3-4b03-983f-cf7e487816bc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:43.029680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa5de6e95884f7b816bea0733a17b19', 'request_id': 'req-be5619a2-06f3-4b03-983f-cf7e487816bc'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:43.045876 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] The token cache is being invalidate because project 4fa5de6e95884f7b816bea0733a17b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:43.047120 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:43.047923 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-be5619a2-06f3-4b03-983f-cf7e487816bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:43.052331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1382/2764] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:42 2022] DELETE /identity/v3/projects/4fa5de6e95884f7b816bea0733a17b19 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:43.906825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:43.906825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:43.920897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acad10-d7d3-4de0-9855-f60d053c7497 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:43.954035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:44.013179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:44.013838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.014125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.014402 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] PATH_INFO: `/v3/users/a3046c64fca242d58e17e3d334ddb6ff` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.015811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3046c64fca242d58e17e3d334ddb6ff)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:44.024978 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:44.068877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3046c64fca242d58e17e3d334ddb6ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.086492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3046c64fca242d58e17e3d334ddb6ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.097388 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3046c64fca242d58e17e3d334ddb6ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.098135 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3046c64fca242d58e17e3d334ddb6ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.118014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3046c64fca242d58e17e3d334ddb6ff'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.125879 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1383/2765] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:43 2022] DELETE /identity/v3/users/a3046c64fca242d58e17e3d334ddb6ff => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:44.130611 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.131082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.131206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.155260 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:44.155918 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:44.232016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1383/2766] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:44.241894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:44.243322 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:44.314117 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e857-47ec-441f-b977-d0a5e0fc890c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:44.317786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950fbc5-c81e-4f44-8a1f-d03b98b91245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:44.318539 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950fbc5-c81e-4f44-8a1f-d03b98b91245 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.318847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950fbc5-c81e-4f44-8a1f-d03b98b91245 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.319167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950fbc5-c81e-4f44-8a1f-d03b98b91245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.330556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950fbc5-c81e-4f44-8a1f-d03b98b91245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:44.332211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950fbc5-c81e-4f44-8a1f-d03b98b91245 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:44.355208 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1384/2767] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:44.659617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:44.661405 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:44.686144 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee9913-0130-440f-ab35-d86f32145370 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:44.692159 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:44.692991 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.693365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.693672 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] PATH_INFO: `/v3/projects/36506faced3b4e5e865cc25a5d4aaf95` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.695413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36506faced3b4e5e865cc25a5d4aaf95)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:44.698174 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:44.739422 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:44.757351 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36506faced3b4e5e865cc25a5d4aaf95', 'request_id': 'req-a7938e5f-07bd-4e77-a948-ce567e1eaba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.764944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36506faced3b4e5e865cc25a5d4aaf95', 'request_id': 'req-a7938e5f-07bd-4e77-a948-ce567e1eaba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.771802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36506faced3b4e5e865cc25a5d4aaf95', 'request_id': 'req-a7938e5f-07bd-4e77-a948-ce567e1eaba8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.786151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] The token cache is being invalidate because project 36506faced3b4e5e865cc25a5d4aaf95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:44.786560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.787082 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a7938e5f-07bd-4e77-a948-ce567e1eaba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:44.789473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1384/2768] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:44 2022] DELETE /identity/v3/projects/36506faced3b4e5e865cc25a5d4aaf95 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:44.794213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.794498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.794771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.814668 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:44.815864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:44.866481 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:44.881056 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1385/2769] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:44.890359 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.890671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.890944 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.911744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:44.913603 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:44.927409 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1385/2770] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:44.929016 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:44.939006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c38c6-1c52-458a-aa1a-446590052dc5 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:44.943674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:44.944336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.944729 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.945011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.945681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:44.945981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:44.947596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:44.960405 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1386/2771] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:44.964926 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:44.974182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66dca-4f22-441f-8ccf-cfaf80ccc9b4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:44.979365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:44.979959 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:44.980235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:44.980535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:44.981259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:44.983148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.012335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1386/2772] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:44 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:45.016561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.029439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42cef3-26fc-45c5-954e-246dacfe8ce8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.090641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.091246 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.091524 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.091792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.092451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.094358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.116561 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1387/2773] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:45 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:45.120651 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.130940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8dab7-64e4-4ae7-8eee-a1c9ebd15e1c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.136305 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.136911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.137199 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.137476 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.138150 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.139766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.150629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1387/2774] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:45.154568 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.164422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96929f-cd6c-40b1-8087-8ff6b286ea3e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.168952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016765a-905d-4806-b432-5edfbc579387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.169536 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016765a-905d-4806-b432-5edfbc579387 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.169815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016765a-905d-4806-b432-5edfbc579387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.170087 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016765a-905d-4806-b432-5edfbc579387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.170716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016765a-905d-4806-b432-5edfbc579387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.172312 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016765a-905d-4806-b432-5edfbc579387 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.182606 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1388/2775] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:45.186533 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.196788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43409-34e9-418f-b328-fba05d0b71c1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.201379 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.202015 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.202290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.202559 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] PATH_INFO: `/v3/projects/dc50e06bb78d450e95b838b904e1839a/users/e190e56c369d40c69ba1b6e8332ec335/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.217649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc50e06bb78d450e95b838b904e1839a, user_id=e190e56c369d40c69ba1b6e8332ec335, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.220239 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.233030 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1388/2776] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:45 2022] PUT /identity/v3/projects/dc50e06bb78d450e95b838b904e1839a/users/e190e56c369d40c69ba1b6e8332ec335/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:45.243412 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.243722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.243996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.270889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] MFA Rules not processed for user `e190e56c369d40c69ba1b6e8332ec335`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:45.272734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:45.333989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1389/2777] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:45.339433 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.407688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42de2f-f632-42e3-8090-f4c32538c05f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.412361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.413050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.413331 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.413605 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.414225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.416131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.442353 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1389/2778] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:45 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:45.447114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.458009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ac610-4a50-4e75-b981-c0e5264d30e0 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.505316 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:45.516426 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.517027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.517306 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.517577 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.518195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.520155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.541334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1390/2779] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:45 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:45.545809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.557356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686370a-dca7-453c-aa5b-c65bc8a1a6bd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.561931 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.562551 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.562838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.563100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.563741 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.565373 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.576265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1390/2780] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:45.580372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.591355 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af414b1c-3867-4f28-8346-5ad707523d6e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.596153 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.596833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.597114 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.597391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] PATH_INFO: `/v3/projects/26af87f19bdc4862a2430620059c9ef0/users/0619bdb7ee11492abce438e48f5c385a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.613143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26af87f19bdc4862a2430620059c9ef0, user_id=0619bdb7ee11492abce438e48f5c385a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.616732 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.629217 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1391/2781] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:45 2022] PUT /identity/v3/projects/26af87f19bdc4862a2430620059c9ef0/users/0619bdb7ee11492abce438e48f5c385a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:45.634337 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.644265 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee0b9-5dca-4ea6-9e0c-2af1d90c5d8e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.669968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:45.703279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca586-c86b-47ef-8227-24172878a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.703877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca586-c86b-47ef-8227-24172878a533 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.704177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca586-c86b-47ef-8227-24172878a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.704480 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca586-c86b-47ef-8227-24172878a533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.705158 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca586-c86b-47ef-8227-24172878a533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.706742 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca586-c86b-47ef-8227-24172878a533 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.728638 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1391/2782] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:45.730190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.742448 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f081d9-ad3a-489c-9b27-ed08b7a4ab54 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.747261 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.747984 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.748293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.748578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] PATH_INFO: `/v3/projects/26af87f19bdc4862a2430620059c9ef0/users/0619bdb7ee11492abce438e48f5c385a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.750702 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26af87f19bdc4862a2430620059c9ef0, user_id=0619bdb7ee11492abce438e48f5c385a, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.754300 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.768152 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1392/2783] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:45 2022] PUT /identity/v3/projects/26af87f19bdc4862a2430620059c9ef0/users/0619bdb7ee11492abce438e48f5c385a/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:45.778898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7b30-2f1b-4357-afb6-ac50850b5c4a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.779185 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7b30-2f1b-4357-afb6-ac50850b5c4a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.779463 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7b30-2f1b-4357-afb6-ac50850b5c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.807514 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-362c7b30-2f1b-4357-afb6-ac50850b5c4a None None] MFA Rules not processed for user `0619bdb7ee11492abce438e48f5c385a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:45.808794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-362c7b30-2f1b-4357-afb6-ac50850b5c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:45.875794 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1392/2784] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:45.888318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:45.890021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:45.948755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a83b48-80cb-4692-a2c1-e836f35b0603 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:45.952361 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:45.952958 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:45.953237 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:45.953509 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:45.962797 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:45.964269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:45.973823 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1393/2785] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:46.086553 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:46.086840 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:46.087112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:46.107560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] MFA Rules not processed for user `0fabcbac1c744d918621344b3dc8a3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:46.108835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:46.169984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1393/2786] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 17 19:36:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:36:46.182766 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:46.184301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:46.258106 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a35c4-d4cf-47e5-b9df-b1c955a89a8c service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:46.263185 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36bfd1-d916-4f68-b5c3-d0bc49488fe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9e4244f9ac349feb38fce19062e7c4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:46.263822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36bfd1-d916-4f68-b5c3-d0bc49488fe8 service swift] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:46.264102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36bfd1-d916-4f68-b5c3-d0bc49488fe8 service swift] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:46.264404 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36bfd1-d916-4f68-b5c3-d0bc49488fe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:46.274515 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36bfd1-d916-4f68-b5c3-d0bc49488fe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:46.276102 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36bfd1-d916-4f68-b5c3-d0bc49488fe8 service swift] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:46.284907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1394/2787] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 17 19:36:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:36:46.417099 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:46.485722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:46.492804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d49ef3-624f-4459-b69c-9f18d67c3ee3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:46.498263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:46.498902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:46.499257 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:46.499537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] PATH_INFO: `/v3/users/e190e56c369d40c69ba1b6e8332ec335` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:46.500693 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e190e56c369d40c69ba1b6e8332ec335)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:46.502721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:46.555752 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e190e56c369d40c69ba1b6e8332ec335'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:46.564506 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e190e56c369d40c69ba1b6e8332ec335'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:46.565198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e190e56c369d40c69ba1b6e8332ec335'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:46.565904 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e190e56c369d40c69ba1b6e8332ec335'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:46.574450 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e190e56c369d40c69ba1b6e8332ec335'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:46.595312 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1394/2788] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:46 2022] DELETE /identity/v3/users/e190e56c369d40c69ba1b6e8332ec335 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:46.601813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:46.602183 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:46.602453 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:46.621612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:46.622815 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:46.665847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:46.699044 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1395/2789] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:46.709206 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:46.710869 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:46.769386 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41b975-c0b9-4b65-966b-a1a592906dcd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:46.773131 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:46.773758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:46.774033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:46.774300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:46.783203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:46.784681 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:46.795333 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1395/2790] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:47.066744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:47.068792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:47.086238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b8f8-1aca-45e1-ba30-e7887809cb96 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:47.091351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:47.092005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:47.092342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:47.092640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] PATH_INFO: `/v3/projects/dc50e06bb78d450e95b838b904e1839a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:47.093818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc50e06bb78d450e95b838b904e1839a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:47.095697 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:47.150278 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc50e06bb78d450e95b838b904e1839a', 'request_id': 'req-fc049786-3b49-4fad-a065-46b4b811bfba'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.158297 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc50e06bb78d450e95b838b904e1839a', 'request_id': 'req-fc049786-3b49-4fad-a065-46b4b811bfba'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.166176 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc50e06bb78d450e95b838b904e1839a', 'request_id': 'req-fc049786-3b49-4fad-a065-46b4b811bfba'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.177488 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] The token cache is being invalidate because project dc50e06bb78d450e95b838b904e1839a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:47.177847 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.178584 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.180340 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1396/2791] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:47 2022] DELETE /identity/v3/projects/dc50e06bb78d450e95b838b904e1839a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:47.184125 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:47.193881 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6160fe-619a-48b5-b2ec-1ad90813e1ff service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:47.253134 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:47.253726 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:47.254006 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:47.254279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] PATH_INFO: `/v3/users/0619bdb7ee11492abce438e48f5c385a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:47.255418 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0619bdb7ee11492abce438e48f5c385a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:47.257623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:47.278905 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:47.308385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0619bdb7ee11492abce438e48f5c385a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.316228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0619bdb7ee11492abce438e48f5c385a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.316890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0619bdb7ee11492abce438e48f5c385a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.317494 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0619bdb7ee11492abce438e48f5c385a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.325044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1feb2d3f-6dd6-4038-a288-80dff63786af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0619bdb7ee11492abce438e48f5c385a'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:47.343542 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1396/2792] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:47 2022] DELETE /identity/v3/users/0619bdb7ee11492abce438e48f5c385a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:47.869194 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:47.870720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:47.891570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc049786-3b49-4fad-a065-46b4b811bfba admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:47.957755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:47.958403 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:47.958687 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:47.958980 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] PATH_INFO: `/v3/projects/26af87f19bdc4862a2430620059c9ef0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:47.960737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26af87f19bdc4862a2430620059c9ef0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:47.962834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.012792 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26af87f19bdc4862a2430620059c9ef0', 'request_id': 'req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.021521 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26af87f19bdc4862a2430620059c9ef0', 'request_id': 'req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.026563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:48.029464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26af87f19bdc4862a2430620059c9ef0', 'request_id': 'req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.043327 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] The token cache is being invalidate because project 26af87f19bdc4862a2430620059c9ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:48.043546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.044204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-5c55937d-1d7b-4e82-b3b7-e8c2b4b3e135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.045777 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1397/2793] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:47 2022] DELETE /identity/v3/projects/26af87f19bdc4862a2430620059c9ef0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:48.050659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.051024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.051372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.074017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:48.075326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.138659 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1397/2794] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:48.148439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.148901 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.149666 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.170223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:48.171450 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.180184 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1398/2795] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:48.184420 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.194238 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b63c-fd7a-41d7-9507-f7adb7bec324 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.199162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.199769 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.200052 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.200361 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.201004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:48.201309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.203001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.216161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1398/2796] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:48.220596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.230852 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba580200-68e4-43b7-9af6-8692e66fe10d None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.235804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.236439 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.236717 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.237051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.237767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.239681 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.270368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.273376 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.279549 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1399/2797] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:48.280700 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.291100 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a463e-8eb9-488a-a7c1-46333385fad5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.351767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb95960-795b-4631-a472-9de9efffbf48 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.352297 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.352938 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.353224 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.353500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] PATH_INFO: `/v3/users/d8021ef7537c4ebf8a0022f1b22816d0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.354628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8021ef7537c4ebf8a0022f1b22816d0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.356574 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.356800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.357408 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.357691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.357965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.358593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.360579 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.383720 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1400/2798] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:48.387413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:48.387804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.398836 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a3eeb-7ff9-4f25-915f-428c6bc23428 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.403619 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.404213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.404518 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.405462 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.406125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.407724 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.408316 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8021ef7537c4ebf8a0022f1b22816d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.417111 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8021ef7537c4ebf8a0022f1b22816d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.417745 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8021ef7537c4ebf8a0022f1b22816d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.418364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8021ef7537c4ebf8a0022f1b22816d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.419925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1401/2799] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:48.423753 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.425454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.426093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8021ef7537c4ebf8a0022f1b22816d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.439040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d702-142e-446e-9727-ef68548b8af8 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.443826 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1a5f-aa18-4860-99eb-c959a87a79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.444671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1a5f-aa18-4860-99eb-c959a87a79d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.444951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1a5f-aa18-4860-99eb-c959a87a79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.445227 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1a5f-aa18-4860-99eb-c959a87a79d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.445679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1399/2800] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:48 2022] DELETE /identity/v3/users/d8021ef7537c4ebf8a0022f1b22816d0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:48.448725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1a5f-aa18-4860-99eb-c959a87a79d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.448725 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1a5f-aa18-4860-99eb-c959a87a79d4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.458695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1402/2801] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:48.463763 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.528596 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a389f-6a09-4fba-9345-a90a7540a5bf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.533439 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.534201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.534509 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.534783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] PATH_INFO: `/v3/projects/e307f8cd73dc4c439dd3381b0ca6b9db/users/66e9b4a683884695aa080ff765ba0af3/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.551164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e307f8cd73dc4c439dd3381b0ca6b9db, user_id=66e9b4a683884695aa080ff765ba0af3, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.553870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.566615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1400/2802] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:48 2022] PUT /identity/v3/projects/e307f8cd73dc4c439dd3381b0ca6b9db/users/66e9b4a683884695aa080ff765ba0af3/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:48.577554 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.577842 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.578126 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.609556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] MFA Rules not processed for user `66e9b4a683884695aa080ff765ba0af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:48.610783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.623568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.625338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.703452 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1403/2803] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:48.707964 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.713898 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ede64-1573-490e-b27c-fd50bb554936 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.718723 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.719360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.719643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.719906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd000259-e54c-4eac-9628-86bd72a15f40 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.720028 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] PATH_INFO: `/v3/projects/6ae6cc259c7f428285b1d00d0374e7a0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.721079 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae6cc259c7f428285b1d00d0374e7a0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.722999 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.724499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.725833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.726289 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.726567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.727197 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.729132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.745330 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:48.756228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:48.759057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1404/2804] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:48.762830 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.777735 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae6cc259c7f428285b1d00d0374e7a0', 'request_id': 'req-f7768d84-fa52-4e66-97dc-b341b85cad98'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.784338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae6cc259c7f428285b1d00d0374e7a0', 'request_id': 'req-f7768d84-fa52-4e66-97dc-b341b85cad98'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.791606 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae6cc259c7f428285b1d00d0374e7a0', 'request_id': 'req-f7768d84-fa52-4e66-97dc-b341b85cad98'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.804800 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] The token cache is being invalidate because project 6ae6cc259c7f428285b1d00d0374e7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:48.805091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.805787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f7768d84-fa52-4e66-97dc-b341b85cad98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:48.807356 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1401/2805] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:48 2022] DELETE /identity/v3/projects/6ae6cc259c7f428285b1d00d0374e7a0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:48.811929 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141c75-14c2-4d31-9510-0d87c44ea182 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.812214 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141c75-14c2-4d31-9510-0d87c44ea182 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.812516 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0141c75-14c2-4d31-9510-0d87c44ea182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.832115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167700e6-3e9c-4400-a257-1a68b27afbd4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.832324 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d0141c75-14c2-4d31-9510-0d87c44ea182 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:48.833375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d0141c75-14c2-4d31-9510-0d87c44ea182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.889443 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.890006 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.890283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.890556 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.891206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.893249 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.894770 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1402/2806] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:48.903200 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.903487 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.903760 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.918916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1405/2807] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:48.920090 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.921765 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.926282 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:48.927451 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:48.933891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e077492-22b4-490a-9399-d1d083ad6c61 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.935340 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1403/2808] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:36:48.939485 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.939804 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.940512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.940798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.941075 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.941721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.943318 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.949429 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac119f9-532d-4dbb-856e-2ec766dc3b9d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.954063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.957532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1406/2809] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:48.957687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.957687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.957687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.957687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:48.957687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.958057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.958527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.969507 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553d71b-918d-4bc4-98a4-69148307152f admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.970730 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1404/2810] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:36:48.974279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.974822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:48.975022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.975307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.975585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] PATH_INFO: `/v3/projects/a02ef0881de148dea918eb611709c424/users/204b14403c0e463a9e630b9cec510415/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.985654 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaa7a0-fc72-4912-b8c5-a394cc78e320 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:48.990746 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:48.991385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:48.991667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:48.991965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02ef0881de148dea918eb611709c424, user_id=204b14403c0e463a9e630b9cec510415, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.992094 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:48.992677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:48.994577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:48.994956 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.014011 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1407/2811] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:48 2022] PUT /identity/v3/projects/a02ef0881de148dea918eb611709c424/users/204b14403c0e463a9e630b9cec510415/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:49.018855 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.032628 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1405/2812] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:48 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:49.034624 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.100940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:49.105018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634837b-a673-4b31-b8e0-b8309e09093a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.118191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248aa40-e5bd-4214-afd9-9cee1f96327d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.122841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.123443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.123722 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.123997 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.124647 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.126549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.151537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1406/2813] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:49 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:49.155427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.161973 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:49.165970 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ca42d-fc3b-49d1-8066-d557e98410a1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.167872 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.168592 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.168874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.169198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.169767 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.171346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.173016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.173755 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.174274 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.174802 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.175468 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.177105 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.184695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1408/2814] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:49.185918 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.187382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1407/2815] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:49.190888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.197583 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898beb4a-3a88-4f89-b54f-a557390ddbb6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.200984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5af51-2abc-44f9-81b9-966e204a206f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.202394 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.203067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.203343 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.203611 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] PATH_INFO: `/v3/projects/a02ef0881de148dea918eb611709c424/users/204b14403c0e463a9e630b9cec510415/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.205534 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02ef0881de148dea918eb611709c424, user_id=204b14403c0e463a9e630b9cec510415, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.205668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4324d-d36b-45fa-af17-5d4b39a7df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.206177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4324d-d36b-45fa-af17-5d4b39a7df46 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.206456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4324d-d36b-45fa-af17-5d4b39a7df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.206725 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4324d-d36b-45fa-af17-5d4b39a7df46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.207347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4324d-d36b-45fa-af17-5d4b39a7df46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.208131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.209170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4324d-d36b-45fa-af17-5d4b39a7df46 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.219552 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1409/2816] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:49 2022] PUT /identity/v3/projects/a02ef0881de148dea918eb611709c424/users/204b14403c0e463a9e630b9cec510415/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:49.220293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1408/2817] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:36:49.224196 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.231106 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.231393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.231666 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.262772 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] MFA Rules not processed for user `204b14403c0e463a9e630b9cec510415`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:49.263982 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:49.288225 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785237-8ddc-4957-ab0b-d512d045805d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.293127 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2255f1e-aa0a-474a-a70d-e23cfcad7ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.293784 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255f1e-aa0a-474a-a70d-e23cfcad7ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.294073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255f1e-aa0a-474a-a70d-e23cfcad7ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.294348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255f1e-aa0a-474a-a70d-e23cfcad7ceb admin admin] PATH_INFO: `/v3/projects/1a3bc5f04da447b5b272c76f183b02e3/users/73b0e4302f8847e0b42f844e45a42fc6/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.309929 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2255f1e-aa0a-474a-a70d-e23cfcad7ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3bc5f04da447b5b272c76f183b02e3, user_id=73b0e4302f8847e0b42f844e45a42fc6, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.312686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2255f1e-aa0a-474a-a70d-e23cfcad7ceb admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.326232 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1410/2818] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:49 2022] PUT /identity/v3/projects/1a3bc5f04da447b5b272c76f183b02e3/users/73b0e4302f8847e0b42f844e45a42fc6/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:49.334732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1409/2819] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:36:49.337505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bccd34-8484-499a-96aa-9889610091af None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.337788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bccd34-8484-499a-96aa-9889610091af None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.338057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bccd34-8484-499a-96aa-9889610091af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.347459 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.348988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:49.364865 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e0bccd34-8484-499a-96aa-9889610091af None None] MFA Rules not processed for user `73b0e4302f8847e0b42f844e45a42fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:49.366946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e0bccd34-8484-499a-96aa-9889610091af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:49.409318 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0175d-9717-464d-9c2a-f8691c4acb09 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.445889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:49.449529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1411/2820] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:49.461265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bccd34-8484-499a-96aa-9889610091af None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.462404 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7c7a-9709-48c4-9511-51f61b97a20e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.462722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e0bccd34-8484-499a-96aa-9889610091af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:49.463155 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7c7a-9709-48c4-9511-51f61b97a20e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.463441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7c7a-9709-48c4-9511-51f61b97a20e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.463744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7c7a-9709-48c4-9511-51f61b97a20e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.474511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bccd34-8484-499a-96aa-9889610091af None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.478277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.478880 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.479155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.479420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.487582 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.489014 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.498572 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1412/2821] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:36:49.504601 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:49.528858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7c7a-9709-48c4-9511-51f61b97a20e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.530287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7c7a-9709-48c4-9511-51f61b97a20e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.540650 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1410/2822] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:36:49.606247 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.674047 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72518be3-8466-4098-b629-925a60661dd1 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.679821 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.680475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.680754 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.681026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] PATH_INFO: `/v3/users/66e9b4a683884695aa080ff765ba0af3` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.682140 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e9b4a683884695aa080ff765ba0af3)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.684037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.732495 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e9b4a683884695aa080ff765ba0af3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:49.752143 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e9b4a683884695aa080ff765ba0af3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:49.761565 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e9b4a683884695aa080ff765ba0af3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:49.762464 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e9b4a683884695aa080ff765ba0af3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:49.771119 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e9b4a683884695aa080ff765ba0af3'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:49.777593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1413/2823] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:49 2022] DELETE /identity/v3/users/66e9b4a683884695aa080ff765ba0af3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:49.782201 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.782493 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.782775 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.804236 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:49.805452 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:49.869164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1411/2824] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:49.880387 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:49.882307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:49.956180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50158e-59cb-4e1a-b186-b7b06902c690 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:49.959806 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:49.960445 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:49.960721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:49.961248 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:49.970786 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:49.972288 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:49.983052 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1414/2825] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:36:50.248903 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:50.250338 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:50.264396 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066a7f-c412-4c86-bcfe-27c63b001c7e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:50.269829 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:50.270740 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:50.271025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:50.271302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] PATH_INFO: `/v3/projects/e307f8cd73dc4c439dd3381b0ca6b9db` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:50.273549 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e307f8cd73dc4c439dd3381b0ca6b9db)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:50.275507 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:50.322891 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e307f8cd73dc4c439dd3381b0ca6b9db', 'request_id': 'req-6bedc2cf-7db2-42a6-b8af-e60da12f463b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.328996 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e307f8cd73dc4c439dd3381b0ca6b9db', 'request_id': 'req-6bedc2cf-7db2-42a6-b8af-e60da12f463b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.335500 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e307f8cd73dc4c439dd3381b0ca6b9db', 'request_id': 'req-6bedc2cf-7db2-42a6-b8af-e60da12f463b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.348132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] The token cache is being invalidate because project e307f8cd73dc4c439dd3381b0ca6b9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:50.348445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.349054 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.351176 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1412/2826] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:50 2022] DELETE /identity/v3/projects/e307f8cd73dc4c439dd3381b0ca6b9db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:50.355190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:50.364972 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82e48e-d54f-4490-b134-3efda842f4ed service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:50.370108 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:50.423265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:50.423894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:50.424174 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:50.424529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] PATH_INFO: `/v3/users/204b14403c0e463a9e630b9cec510415` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:50.425585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=204b14403c0e463a9e630b9cec510415)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:50.427494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:50.475167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204b14403c0e463a9e630b9cec510415'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.487798 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204b14403c0e463a9e630b9cec510415'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.494764 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204b14403c0e463a9e630b9cec510415'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.495429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204b14403c0e463a9e630b9cec510415'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.502198 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-49dc8cbe-d91c-4a00-971e-5d09797ee47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204b14403c0e463a9e630b9cec510415'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.508537 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1415/2827] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:50 2022] DELETE /identity/v3/users/204b14403c0e463a9e630b9cec510415 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:50.782288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:50.784413 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:50.810326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedc2cf-7db2-42a6-b8af-e60da12f463b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:50.865050 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:50.872597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:50.873288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:50.873777 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:50.874097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] PATH_INFO: `/v3/projects/a02ef0881de148dea918eb611709c424` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:50.875589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02ef0881de148dea918eb611709c424)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:50.877578 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:50.923266 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02ef0881de148dea918eb611709c424', 'request_id': 'req-97c865eb-0312-483b-888d-9fee226209a8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.929900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02ef0881de148dea918eb611709c424', 'request_id': 'req-97c865eb-0312-483b-888d-9fee226209a8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.935427 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02ef0881de148dea918eb611709c424', 'request_id': 'req-97c865eb-0312-483b-888d-9fee226209a8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.948175 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] The token cache is being invalidate because project a02ef0881de148dea918eb611709c424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:50.948484 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.949113 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-97c865eb-0312-483b-888d-9fee226209a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:50.950563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1413/2828] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:50 2022] DELETE /identity/v3/projects/a02ef0881de148dea918eb611709c424 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:50.956612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:50.956894 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:50.957168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:50.977837 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:50.979113 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:51.043040 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1416/2829] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:51.050580 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.050872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.051128 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.072132 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:51.073364 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:51.082096 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1414/2830] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:51.087721 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.099027 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8958-0a9f-44b9-8f83-5818db9f9cfb None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.105974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.107001 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.107498 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.107820 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] PATH_INFO: `/v3/domains` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.108540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:36:51.108853 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.110474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.124447 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1417/2831] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:36:51.128864 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.139076 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44cb56-d1a8-4e50-aabf-9b3318697bfc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.143867 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.144492 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.144837 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.145035 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.145900 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.148319 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.190021 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1415/2832] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:51.194009 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.204110 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc4daf-006b-427b-8700-1f3935105722 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.216057 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:51.263643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.264264 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.264547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.264817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.265427 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.267321 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.288718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1418/2833] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:51.292878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.303658 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1a1b-7f74-4280-8428-6cea00670ff5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.308142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.308750 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.309026 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.309293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.309949 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.311518 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.321363 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1416/2834] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:51.325235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.336213 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385972a-7b57-44fe-a9ef-f6268bc5bb85 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.340856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89707a08-1d00-4ec9-9cfe-d6a87546904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.341451 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89707a08-1d00-4ec9-9cfe-d6a87546904b admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.341734 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89707a08-1d00-4ec9-9cfe-d6a87546904b admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.342017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89707a08-1d00-4ec9-9cfe-d6a87546904b admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.342662 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89707a08-1d00-4ec9-9cfe-d6a87546904b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.344257 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89707a08-1d00-4ec9-9cfe-d6a87546904b admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.355691 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1419/2835] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:51.359816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.370958 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677820-0adb-4773-a07b-3f2a26fa8f41 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.375617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.376283 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.376568 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.376843 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] PATH_INFO: `/v3/projects/1427f75debbf4b84b31a48ce1c89aac1/users/9ad849274e954cdb82619a9ece0ae6a7/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.391614 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1427f75debbf4b84b31a48ce1c89aac1, user_id=9ad849274e954cdb82619a9ece0ae6a7, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.394302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.408523 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1417/2836] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:51 2022] PUT /identity/v3/projects/1427f75debbf4b84b31a48ce1c89aac1/users/9ad849274e954cdb82619a9ece0ae6a7/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:51.419586 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.419878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.420154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.456951 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] MFA Rules not processed for user `9ad849274e954cdb82619a9ece0ae6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:51.458181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:51.526457 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1420/2837] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:51.531000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.595599 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1f803-5c91-4b7d-b22c-4fab2afe77f7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.600841 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.601435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.601713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.601984 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.602598 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.604511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.630091 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1418/2838] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:51.634325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.644950 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87bbb-b82f-4d2e-9f86-b8faf39ac644 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.700916 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.701517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.701805 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.702072 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.702695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.704636 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.726682 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1421/2839] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:51.730713 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.741119 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ad2b-1333-445b-8af6-52d0cfac0a6e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.745941 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.746537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.746816 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.747088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.747728 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.749339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.751447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:51.761481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1419/2840] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:51.765527 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.779458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107efd5-111b-4555-8866-7bc69e22bd12 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.788645 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f60a03-1696-4d60-bdce-c05c55c3456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.789254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f60a03-1696-4d60-bdce-c05c55c3456f admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.789567 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f60a03-1696-4d60-bdce-c05c55c3456f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.789833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f60a03-1696-4d60-bdce-c05c55c3456f admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.790476 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f60a03-1696-4d60-bdce-c05c55c3456f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.792071 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f60a03-1696-4d60-bdce-c05c55c3456f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.802635 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1422/2841] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:51.807101 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:51.817172 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbfff-5742-4a25-a201-c30bee2a67be admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:51.821795 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:51.822441 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.822724 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.823001 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] PATH_INFO: `/v3/projects/2b4bf8c6c3bd40bea12415bfc9f0acea/users/5ee99d7a79bf4132a6b619bb6e3d68b4/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.838456 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4bf8c6c3bd40bea12415bfc9f0acea, user_id=5ee99d7a79bf4132a6b619bb6e3d68b4, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:51.841130 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:51.854303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1420/2842] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:51 2022] PUT /identity/v3/projects/2b4bf8c6c3bd40bea12415bfc9f0acea/users/5ee99d7a79bf4132a6b619bb6e3d68b4/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:51.865827 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:51.866293 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:51.866580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:51.873727 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:51.898254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] MFA Rules not processed for user `5ee99d7a79bf4132a6b619bb6e3d68b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:51.899474 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:51.964170 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1423/2843] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:51.968691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.032162 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18fbaa-fcf4-4058-8b55-8ea416084aa1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.037013 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.038032 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.038334 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.038615 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.039279 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.041202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.066980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1421/2844] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:36:51 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:36:52.071809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.082598 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7ae65-971b-44b6-9b9b-07c6ce314574 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.155049 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.155664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.155949 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.156224 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.156898 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.158803 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.183977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1424/2845] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:36:52 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:36:52.188198 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.199278 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582473b-95d8-4800-9f68-b0df4abb25fd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.204272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.204888 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.205170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.205447 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.206147 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.207779 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.226329 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1422/2846] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:52.232371 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.243055 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b260-a139-40b1-a125-75373a322ee4 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.247740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.248430 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.248711 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.248983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] PATH_INFO: `/v3/projects/e47f1bfc77674095b9b291cd52ca774e/users/359d668c5b684fcea6e29547bdfddb67/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.264277 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47f1bfc77674095b9b291cd52ca774e, user_id=359d668c5b684fcea6e29547bdfddb67, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.266896 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.279910 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1425/2847] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:52 2022] PUT /identity/v3/projects/e47f1bfc77674095b9b291cd52ca774e/users/359d668c5b684fcea6e29547bdfddb67/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:52.283933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.294401 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f704a-7c6e-4b12-a068-af7b11d14dda admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.354817 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e473476-5957-4fa1-b34f-aaefad63e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.355457 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e473476-5957-4fa1-b34f-aaefad63e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.355732 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e473476-5957-4fa1-b34f-aaefad63e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.356002 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e473476-5957-4fa1-b34f-aaefad63e8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.356673 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e473476-5957-4fa1-b34f-aaefad63e8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.358253 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e473476-5957-4fa1-b34f-aaefad63e8ed admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.368787 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1423/2848] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:36:52.373505 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.384769 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402986c-69f2-44c2-a719-02af9b73db0c admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.389375 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.390026 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.390304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.390596 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] PATH_INFO: `/v3/projects/e47f1bfc77674095b9b291cd52ca774e/users/359d668c5b684fcea6e29547bdfddb67/roles/26fe7cfbf4cc45afa71282a7cf3ac91a` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.392530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47f1bfc77674095b9b291cd52ca774e, user_id=359d668c5b684fcea6e29547bdfddb67, role_id=26fe7cfbf4cc45afa71282a7cf3ac91a)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.395139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.405188 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1426/2849] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:36:52 2022] PUT /identity/v3/projects/e47f1bfc77674095b9b291cd52ca774e/users/359d668c5b684fcea6e29547bdfddb67/roles/26fe7cfbf4cc45afa71282a7cf3ac91a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:52.415290 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.415577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.415852 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.455063 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] MFA Rules not processed for user `359d668c5b684fcea6e29547bdfddb67`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:52.456352 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:52.491909 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:52.530513 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1424/2850] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:52.541215 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:52.543000 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:52.591640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:52.602965 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3784b6-a0be-4d44-bef9-cacf34b2981e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:52.606563 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:52.607154 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:52.607429 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:52.607701 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:52.617190 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:52.618612 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:52.627839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1427/2851] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:53.119393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:53.121151 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:53.133362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d63380-5b63-4a86-ac7a-1e307f0cff3f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:53.136831 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9560-9ef8-41a7-a14b-4d14d8600428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:53.137424 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9560-9ef8-41a7-a14b-4d14d8600428 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:53.137699 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9560-9ef8-41a7-a14b-4d14d8600428 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:53.137971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9560-9ef8-41a7-a14b-4d14d8600428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:53.194910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9560-9ef8-41a7-a14b-4d14d8600428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:53.196765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9560-9ef8-41a7-a14b-4d14d8600428 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:53.205623 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1425/2852] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:54.553480 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:54.558746 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:54.638146 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab05bf-c4ba-4de5-9652-ebeaa14eeec3 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:54.644628 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:54.645315 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:54.645548 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:54.645817 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] PATH_INFO: `/v3/users/73b0e4302f8847e0b42f844e45a42fc6` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:54.646977 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b0e4302f8847e0b42f844e45a42fc6)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:54.649051 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:54.705203 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b0e4302f8847e0b42f844e45a42fc6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:54.721024 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b0e4302f8847e0b42f844e45a42fc6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:54.729818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b0e4302f8847e0b42f844e45a42fc6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:54.730500 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b0e4302f8847e0b42f844e45a42fc6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:54.740660 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b0e4302f8847e0b42f844e45a42fc6'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:54.748637 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1428/2853] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:54 2022] DELETE /identity/v3/users/73b0e4302f8847e0b42f844e45a42fc6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:54.753289 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:54.753803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:54.753803 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:54.773662 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:54.774788 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:54.843088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1426/2854] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:54.854566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:54.856103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:54.919529 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4d5cc-5c5d-43e0-9f69-dac4903d6739 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:54.923279 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:54.923889 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:54.924367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:54.924511 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:54.935182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:54.936706 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:54.947982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1429/2855] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:36:55.257512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:55.258972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:55.272097 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecd143-5b61-462c-bfe4-79ecdbba596b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:55.277586 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:55.278226 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:55.278504 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:55.278776 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] PATH_INFO: `/v3/projects/1a3bc5f04da447b5b272c76f183b02e3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:55.280327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3bc5f04da447b5b272c76f183b02e3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:55.282397 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:55.334765 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3bc5f04da447b5b272c76f183b02e3', 'request_id': 'req-59019622-96ec-4136-a434-a06e1b6a3242'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:55.343037 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3bc5f04da447b5b272c76f183b02e3', 'request_id': 'req-59019622-96ec-4136-a434-a06e1b6a3242'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:55.350335 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3bc5f04da447b5b272c76f183b02e3', 'request_id': 'req-59019622-96ec-4136-a434-a06e1b6a3242'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:55.353592 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:55.366467 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] The token cache is being invalidate because project 1a3bc5f04da447b5b272c76f183b02e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:36:55.366754 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:55.367423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:55.368972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1427/2856] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:36:55 2022] DELETE /identity/v3/projects/1a3bc5f04da447b5b272c76f183b02e3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:36:57.258730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:57.260168 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:57.270831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:36:57.318985 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a3dc-155b-4632-9d40-3516c2437e4c service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:57.367390 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:57.368022 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:57.368336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:57.368614 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:57.370370 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:57.427683 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:57.429809 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95546a-9385-4098-833c-82c81fd01edc service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:57.438644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1430/2857] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:36:59.516458 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:59.517937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:59.586254 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019622-96ec-4136-a434-a06e1b6a3242 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:59.592034 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:59.592691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:59.592972 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:59.593245 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] PATH_INFO: `/v3/users/9ad849274e954cdb82619a9ece0ae6a7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:59.594365 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad849274e954cdb82619a9ece0ae6a7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:59.596499 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:59.642295 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad849274e954cdb82619a9ece0ae6a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:59.649284 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad849274e954cdb82619a9ece0ae6a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:59.650942 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad849274e954cdb82619a9ece0ae6a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:59.651554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad849274e954cdb82619a9ece0ae6a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:59.658530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad849274e954cdb82619a9ece0ae6a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:36:59.675968 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1428/2858] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:36:59 2022] DELETE /identity/v3/users/9ad849274e954cdb82619a9ece0ae6a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:36:59.681012 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:59.681497 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:59.681609 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:59.701743 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:36:59.702942 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:59.763530 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1431/2859] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:36:59.773033 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:36:59.775122 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:36:59.832425 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c0152-0e9a-48e8-853f-ab82e9555bf5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:36:59.836327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:36:59.837089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:36:59.837368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:36:59.837645 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:36:59.861709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:36:59.863191 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:36:59.874539 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1429/2860] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:00.139674 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:00.141178 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:00.153610 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dda5cf-daec-4f4e-8364-096c7112fdc4 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:00.158179 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:00.158838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:00.159115 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:00.159465 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] PATH_INFO: `/v3/projects/1427f75debbf4b84b31a48ce1c89aac1` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:00.160644 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1427f75debbf4b84b31a48ce1c89aac1)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:00.162550 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:00.179555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=100 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:00.210307 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1427f75debbf4b84b31a48ce1c89aac1', 'request_id': 'req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.218446 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1427f75debbf4b84b31a48ce1c89aac1', 'request_id': 'req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.223953 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1427f75debbf4b84b31a48ce1c89aac1', 'request_id': 'req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.235540 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] The token cache is being invalidate because project 1427f75debbf4b84b31a48ce1c89aac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:37:00.235813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.236463 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.237944 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1432/2861] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:37:00 2022] DELETE /identity/v3/projects/1427f75debbf4b84b31a48ce1c89aac1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:00.241989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:00.252293 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e419-e44c-45c5-a91d-36338478fbc8 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:00.261170 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:00.310953 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:00.311583 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:00.311863 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:00.312140 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] PATH_INFO: `/v3/users/5ee99d7a79bf4132a6b619bb6e3d68b4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:00.313292 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee99d7a79bf4132a6b619bb6e3d68b4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:00.315195 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:00.362311 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee99d7a79bf4132a6b619bb6e3d68b4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.369479 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee99d7a79bf4132a6b619bb6e3d68b4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.370161 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee99d7a79bf4132a6b619bb6e3d68b4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.370825 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee99d7a79bf4132a6b619bb6e3d68b4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.378014 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee99d7a79bf4132a6b619bb6e3d68b4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.395179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1430/2862] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:37:00 2022] DELETE /identity/v3/users/5ee99d7a79bf4132a6b619bb6e3d68b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:00.665788 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:00.667262 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:00.681274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ece3f0-e869-4b2b-b58f-4f328f1f2888 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:00.739211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:00.739995 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:00.740301 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:00.740580 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] PATH_INFO: `/v3/projects/2b4bf8c6c3bd40bea12415bfc9f0acea` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:00.741757 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4bf8c6c3bd40bea12415bfc9f0acea)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:00.744236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:00.791562 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4bf8c6c3bd40bea12415bfc9f0acea', 'request_id': 'req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.799005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4bf8c6c3bd40bea12415bfc9f0acea', 'request_id': 'req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.804925 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4bf8c6c3bd40bea12415bfc9f0acea', 'request_id': 'req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.816383 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] The token cache is being invalidate because project 2b4bf8c6c3bd40bea12415bfc9f0acea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:37:00.816671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.817334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.818810 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1433/2863] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:37:00 2022] DELETE /identity/v3/projects/2b4bf8c6c3bd40bea12415bfc9f0acea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:00.823566 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:00.825041 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:00.838975 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346523f0-6ee2-4ddc-827e-317301582d47 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:00.897044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:00.897744 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:00.897992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:00.901112 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] PATH_INFO: `/v3/users/359d668c5b684fcea6e29547bdfddb67` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:00.902291 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=359d668c5b684fcea6e29547bdfddb67)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:00.904234 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:00.941793 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:00.953093 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359d668c5b684fcea6e29547bdfddb67'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.960044 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359d668c5b684fcea6e29547bdfddb67'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.960711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359d668c5b684fcea6e29547bdfddb67'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.961644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359d668c5b684fcea6e29547bdfddb67'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.969393 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c43691a0-ad64-4b26-a89d-2691ceef7f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359d668c5b684fcea6e29547bdfddb67'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:00.987360 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1431/2864] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:37:00 2022] DELETE /identity/v3/users/359d668c5b684fcea6e29547bdfddb67 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:01.270017 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.271501 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:01.284206 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bbb5c-b7c9-4212-bad3-639d6fde897a admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.314948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:01.344813 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.345411 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.345689 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.345961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] PATH_INFO: `/v3/projects/e47f1bfc77674095b9b291cd52ca774e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.347078 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47f1bfc77674095b9b291cd52ca774e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.349018 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.395771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47f1bfc77674095b9b291cd52ca774e', 'request_id': 'req-74f82088-e324-4690-8a40-892c14fccd0f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:01.403181 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47f1bfc77674095b9b291cd52ca774e', 'request_id': 'req-74f82088-e324-4690-8a40-892c14fccd0f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:01.408624 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47f1bfc77674095b9b291cd52ca774e', 'request_id': 'req-74f82088-e324-4690-8a40-892c14fccd0f'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:01.419410 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] The token cache is being invalidate because project e47f1bfc77674095b9b291cd52ca774e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:37:01.419695 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:01.420385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-74f82088-e324-4690-8a40-892c14fccd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:01.421861 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1434/2865] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:37:01 2022] DELETE /identity/v3/projects/e47f1bfc77674095b9b291cd52ca774e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:01.427917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.428211 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.428524 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.450820 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:01.452012 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:01.514676 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1432/2866] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:01.533290 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.533578 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.533856 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.557585 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:01.558850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:01.567111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1435/2867] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:01.572165 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.583478 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db2ed-7f39-48b4-a0ea-7dc9759f4db4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.589187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.589807 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.590089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.590362 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.591017 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:37:01.591317 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.592960 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.609674 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1433/2868] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:37:01.611109 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.622444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af10c4d-9897-45fd-a8e5-a87c352863eb None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.627414 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.628030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.628346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.628620 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.629302 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.631233 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.658327 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1436/2869] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:37:01 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:37:01.662680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.673326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c82b-d1cf-4eb0-9380-225f12063771 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.730486 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.731088 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.731389 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.731644 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.732275 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.734187 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.754646 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1434/2870] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:37:01 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:37:01.758974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.769352 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45134f-0b8d-43e6-b641-28e245e55a9d admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.773935 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.774566 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.774850 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.775124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.775771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.777406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.787111 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1437/2871] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:37:01.791665 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.801554 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795762-9303-4bc3-94ae-ac7c614a28ce admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.806783 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed1e4-c360-489c-a9be-15b199c45a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.807372 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed1e4-c360-489c-a9be-15b199c45a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.807649 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed1e4-c360-489c-a9be-15b199c45a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.807919 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed1e4-c360-489c-a9be-15b199c45a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.808585 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed1e4-c360-489c-a9be-15b199c45a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.810154 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed1e4-c360-489c-a9be-15b199c45a92 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.820563 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1435/2872] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:37:01.824593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:01.834413 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b080e-0c43-4560-a32b-611e25dd6a06 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:01.839831 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:01.840520 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.840829 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.841124 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] PATH_INFO: `/v3/projects/d3c08091ef4c42188d5a7f1070bb9c7e/users/b292713dd60640bebb214ee7dfcca425/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.856848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c08091ef4c42188d5a7f1070bb9c7e, user_id=b292713dd60640bebb214ee7dfcca425, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:01.859484 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:01.872983 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1438/2873] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:37:01 2022] PUT /identity/v3/projects/d3c08091ef4c42188d5a7f1070bb9c7e/users/b292713dd60640bebb214ee7dfcca425/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:01.939042 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:01.939588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:01.939588 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:01.968142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] MFA Rules not processed for user `b292713dd60640bebb214ee7dfcca425`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:01.969382 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:01.974327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:02.036520 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1436/2874] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:02.049182 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:02.050868 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:02.109005 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071cd94-f5fa-4c00-9cea-fbc390f61c70 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:02.112740 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9ceff-2d25-4261-b41a-6b8a8e17ad66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:02.113339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9ceff-2d25-4261-b41a-6b8a8e17ad66 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:02.113623 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9ceff-2d25-4261-b41a-6b8a8e17ad66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:02.113899 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9ceff-2d25-4261-b41a-6b8a8e17ad66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:02.122789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9ceff-2d25-4261-b41a-6b8a8e17ad66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:02.124287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9ceff-2d25-4261-b41a-6b8a8e17ad66 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:02.133021 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1439/2875] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:04.681153 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:04.743680 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a037784-9b6d-47ac-9bd6-32a3b494046f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:04.748213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:04.748878 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:04.749157 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:04.749426 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] PATH_INFO: `/v3/users/b292713dd60640bebb214ee7dfcca425` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:04.750560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b292713dd60640bebb214ee7dfcca425)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:04.752530 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:04.799602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b292713dd60640bebb214ee7dfcca425'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:04.807813 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b292713dd60640bebb214ee7dfcca425'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:04.808631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b292713dd60640bebb214ee7dfcca425'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:04.809242 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b292713dd60640bebb214ee7dfcca425'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:04.816287 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b292713dd60640bebb214ee7dfcca425'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:04.833535 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1437/2876] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:37:04 2022] DELETE /identity/v3/users/b292713dd60640bebb214ee7dfcca425 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:04.839122 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:04.839588 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:04.839705 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:04.846641 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:04.861783 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:04.862992 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:04.924656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1440/2877] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:04.934879 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:04.936288 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:04.967024 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:04.996167 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bae72-4ffc-4459-9b39-8ad9732f947c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.000095 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2401a-6e6c-4233-a680-1f86acf1387f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.000609 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2401a-6e6c-4233-a680-1f86acf1387f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.000890 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2401a-6e6c-4233-a680-1f86acf1387f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.001163 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2401a-6e6c-4233-a680-1f86acf1387f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.011160 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2401a-6e6c-4233-a680-1f86acf1387f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.012627 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2401a-6e6c-4233-a680-1f86acf1387f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.021989 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1438/2878] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:05.297512 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.298997 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:05.311873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5df8-a1d4-4101-aa03-ecbbede25c0b None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.316506 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.317622 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.318069 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.318347 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] PATH_INFO: `/v3/projects/d3c08091ef4c42188d5a7f1070bb9c7e` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.319468 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c08091ef4c42188d5a7f1070bb9c7e)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.321876 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.368032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c08091ef4c42188d5a7f1070bb9c7e', 'request_id': 'req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:05.375211 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c08091ef4c42188d5a7f1070bb9c7e', 'request_id': 'req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:05.380590 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c08091ef4c42188d5a7f1070bb9c7e', 'request_id': 'req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:05.391678 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] The token cache is being invalidate because project d3c08091ef4c42188d5a7f1070bb9c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:37:05.391959 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:05.392597 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-60fcf2a6-0bac-49f7-a76c-0869781ee8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:05.394041 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1441/2879] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:37:05 2022] DELETE /identity/v3/projects/d3c08091ef4c42188d5a7f1070bb9c7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:05.398992 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.399893 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.400218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.419272 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:05.420508 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:05.479977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1439/2880] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:05.487570 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.487882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.488159 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.508255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:05.510533 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:05.518339 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1442/2881] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:05.522502 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.532668 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7e2c-21f4-48bd-b75c-aee067501800 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.537123 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.537711 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.537983 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.538252 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.538886 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:37:05.539213 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.541057 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.552231 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1440/2882] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:37:05.556735 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.566045 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc823-8716-4f40-b3fb-b0fa30bbf8bc None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.570643 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.571946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.572358 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.572655 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.573369 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.575268 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.602952 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1443/2883] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:37:05 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:37:05.607179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.617137 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962607fb-7c86-4aaa-afcc-b16b182b701d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.673591 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.674178 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.674453 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.674721 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.675339 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.677460 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.698590 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1441/2884] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:37:05 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:37:05.702722 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.713744 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2644-a1c2-4dab-a206-25e78ec22f95 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.718535 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.719145 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.719421 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.719690 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.720354 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.721938 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.732946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1444/2885] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:37:05.736962 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.747182 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606a21-1a83-4f42-b27f-e7585e14adf1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.752696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ba52-203e-4c4c-92f7-982805f6f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.753309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ba52-203e-4c4c-92f7-982805f6f2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.753577 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ba52-203e-4c4c-92f7-982805f6f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.754020 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ba52-203e-4c4c-92f7-982805f6f2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.756064 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ba52-203e-4c4c-92f7-982805f6f2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.757940 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ba52-203e-4c4c-92f7-982805f6f2a6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.772617 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1442/2886] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:37:05.778088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.789013 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2bf1-086b-4b84-99f4-1c503b6880ef admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:05.794874 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:05.795531 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.795981 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.796271 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] PATH_INFO: `/v3/projects/93ae6153c5ff42b5bfef82e4e75a1a50/users/e19ea242dfc6442085fdd1578659abac/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.814854 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ae6153c5ff42b5bfef82e4e75a1a50, user_id=e19ea242dfc6442085fdd1578659abac, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:05.817613 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:05.830652 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1445/2887] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:37:05 2022] PUT /identity/v3/projects/93ae6153c5ff42b5bfef82e4e75a1a50/users/e19ea242dfc6442085fdd1578659abac/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:37:05.843309 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:05.843597 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:05.843870 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:05.871537 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] MFA Rules not processed for user `e19ea242dfc6442085fdd1578659abac`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:05.872774 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:05.895778 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:05.938219 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1443/2888] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:05.949974 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:05.951748 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:05.983062 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:06.012444 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08c29-0fae-4d73-be53-2c2302140a8e admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:06.016077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796b60-725b-44a0-b563-1dd54976daaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11289ffa17db4fe3b3c4b5ad034a4dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:06.016715 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796b60-725b-44a0-b563-1dd54976daaf service glance] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:06.016999 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796b60-725b-44a0-b563-1dd54976daaf service glance] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:06.017275 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796b60-725b-44a0-b563-1dd54976daaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:06.026092 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796b60-725b-44a0-b563-1dd54976daaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:06.027633 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796b60-725b-44a0-b563-1dd54976daaf service glance] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:06.036564 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1446/2889] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:15.935300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=16 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:16.032475 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=16 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:30.708443 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:30.771515 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0669-4e81-47a8-9d2d-d67c4ba9b18b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:30.776049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:30.776858 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:30.777142 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:30.777416 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] PATH_INFO: `/v3/users/e19ea242dfc6442085fdd1578659abac` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:30.778541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19ea242dfc6442085fdd1578659abac)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:30.780473 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:30.829357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19ea242dfc6442085fdd1578659abac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:30.836784 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19ea242dfc6442085fdd1578659abac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:30.837385 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19ea242dfc6442085fdd1578659abac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:30.837980 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19ea242dfc6442085fdd1578659abac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:30.845179 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19ea242dfc6442085fdd1578659abac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:30.862696 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1444/2890] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:37:30 2022] DELETE /identity/v3/users/e19ea242dfc6442085fdd1578659abac => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:30.867458 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:30.867954 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:30.868082 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:30.887417 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:30.888656 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:30.945456 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1447/2891] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:37:30.955068 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:30.956511 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:31.015423 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b142df-927f-47a9-bb3c-0872c3b60ca8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.019114 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c43f2-62cc-4300-bd42-19b5b8b6e101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.019716 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c43f2-62cc-4300-bd42-19b5b8b6e101 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.020016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c43f2-62cc-4300-bd42-19b5b8b6e101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.020307 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c43f2-62cc-4300-bd42-19b5b8b6e101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.029263 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c43f2-62cc-4300-bd42-19b5b8b6e101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.030671 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c43f2-62cc-4300-bd42-19b5b8b6e101 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.039872 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1445/2892] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:31.303710 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.305269 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:31.317940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724258-8d1f-4331-8060-296aca2c7fbf None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.322737 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.323496 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.323887 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.324167 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] PATH_INFO: `/v3/projects/93ae6153c5ff42b5bfef82e4e75a1a50` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.325346 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ae6153c5ff42b5bfef82e4e75a1a50)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.327254 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.376218 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ae6153c5ff42b5bfef82e4e75a1a50', 'request_id': 'req-05f676da-c19d-4dc3-bda5-ad64d0f51d42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:31.383351 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ae6153c5ff42b5bfef82e4e75a1a50', 'request_id': 'req-05f676da-c19d-4dc3-bda5-ad64d0f51d42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:31.389235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ae6153c5ff42b5bfef82e4e75a1a50', 'request_id': 'req-05f676da-c19d-4dc3-bda5-ad64d0f51d42'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:31.400036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] The token cache is being invalidate because project 93ae6153c5ff42b5bfef82e4e75a1a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:37:31.400366 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:31.401538 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-05f676da-c19d-4dc3-bda5-ad64d0f51d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:31.403207 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1448/2893] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:37:31 2022] DELETE /identity/v3/projects/93ae6153c5ff42b5bfef82e4e75a1a50 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:31.408345 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.408630 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.408902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.428679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:31.429866 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:31.447407 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:31.491357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1446/2894] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:31.499589 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.499877 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.500155 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.520030 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.auth.core [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:31.521291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:31.529782 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1449/2895] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:31.533933 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.543536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53001747-27e7-499e-b901-e0196f9843b9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.548016 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.548643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.548921 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.549188 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.549821 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:37:31.550117 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.551677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.563604 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1447/2896] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 17 19:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:37:31.567860 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.577825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c6827-00e8-4348-b2ff-aeab5b5b59c9 None None] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.582499 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.583088 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.583372 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.583646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.584304 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.586471 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.614229 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1450/2897] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 17 19:37:31 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:37:31.618228 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.628575 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c11fd-203d-4c69-8270-2774f54ffd9e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.683055 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.683643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.683917 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.684186 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.684828 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.686709 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.707689 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1448/2898] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 17 19:37:31 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:37:31.711882 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.723517 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4106c-0c22-404f-af0c-fe86d194fef6 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.730205 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.731139 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.731569 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.731989 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.733077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.735036 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.746632 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1451/2899] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:37:31.750714 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.761286 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d68b3-d2b8-41f9-95a3-86f259f3aa8c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.766262 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8677f2-b3ac-4e00-9d89-646ff9097588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.766865 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8677f2-b3ac-4e00-9d89-646ff9097588 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.767148 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8677f2-b3ac-4e00-9d89-646ff9097588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.767445 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8677f2-b3ac-4e00-9d89-646ff9097588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.768089 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8677f2-b3ac-4e00-9d89-646ff9097588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.769748 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8677f2-b3ac-4e00-9d89-646ff9097588 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.780481 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1449/2900] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 17 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:37:31.784542 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.795334 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9e735-ee98-412a-a3ef-e66b6f1180fc admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:31.800035 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:31.800755 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.801032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.801327 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] PATH_INFO: `/v3/projects/136bb36ef1884d8fad68f0bef2cb9a03/users/8f9a05951d714540b24073e77a0e3fb1/roles/2714b27e089e443cb0f836617a1eb5b0` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.817175 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136bb36ef1884d8fad68f0bef2cb9a03, user_id=8f9a05951d714540b24073e77a0e3fb1, role_id=2714b27e089e443cb0f836617a1eb5b0)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:31.819811 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:31.832756 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1452/2901] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 17 19:37:31 2022] PUT /identity/v3/projects/136bb36ef1884d8fad68f0bef2cb9a03/users/8f9a05951d714540b24073e77a0e3fb1/roles/2714b27e089e443cb0f836617a1eb5b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:31.843957 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:31.844273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:31.844555 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:31.874110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] MFA Rules not processed for user `8f9a05951d714540b24073e77a0e3fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:31.875328 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:31.939225 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1450/2902] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:31.949873 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:31.951557 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:31.973422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:32.013848 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b8ee2-da18-470c-962d-a78124381403 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:32.017646 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f26c0d36d3054f098c05b3cdb93853b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:32.018454 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:32.018946 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:32.019320 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:32.046789 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:32.048223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:32.057906 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1453/2903] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:41.936326 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:42.053255 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=17 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:42.109421 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:42.110835 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:42.168988 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c6d0-ba8d-4b46-98b0-b0a32764229a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:42.172691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:42.173302 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:42.173581 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:42.173877 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:42.175613 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:42.186440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:42.187902 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228934b-26a4-4825-be43-ce8976d45a66 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:42.196039 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1451/2904] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:42.266037 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:42.334020 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7c850-3dd7-4395-b468-dc35d5a24963 service cinder] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:42.339431 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:42.340067 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:42.340385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:42.340653 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] PATH_INFO: `/v3/users/8f9a05951d714540b24073e77a0e3fb1` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:42.341775 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9a05951d714540b24073e77a0e3fb1)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:42.343692 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:42.395470 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9a05951d714540b24073e77a0e3fb1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.410948 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9a05951d714540b24073e77a0e3fb1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.419032 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9a05951d714540b24073e77a0e3fb1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.419825 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9a05951d714540b24073e77a0e3fb1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.427147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9a05951d714540b24073e77a0e3fb1'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.433912 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1454/2905] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:37:42 2022] DELETE /identity/v3/users/8f9a05951d714540b24073e77a0e3fb1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:42.438366 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:42.438594 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:42.438871 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:42.458631 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] MFA Rules not processed for user `a53f1ba3fed7453aacc3b6fcf0875642`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:37:42.459851 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:42.520490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1452/2906] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 17 19:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:37:42.530336 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:42.531771 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:42.592790 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107892fb-8d41-4438-b0b5-7ce65e7cca98 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:42.596391 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:42.597003 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:42.597283 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:42.597555 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:42.606800 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:42.608236 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:42.617982 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1455/2907] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:42.897384 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:42.898822 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:42.910977 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94d7b8-1dd3-4554-a389-38a6f9a1ff8a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:42.915602 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:42.916913 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:42.917202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:42.917454 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] PATH_INFO: `/v3/projects/136bb36ef1884d8fad68f0bef2cb9a03` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:42.918593 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136bb36ef1884d8fad68f0bef2cb9a03)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:42.920531 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:42.968109 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136bb36ef1884d8fad68f0bef2cb9a03', 'request_id': 'req-267e3287-5591-474f-a17a-937004f706b1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.974203 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136bb36ef1884d8fad68f0bef2cb9a03', 'request_id': 'req-267e3287-5591-474f-a17a-937004f706b1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.980688 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136bb36ef1884d8fad68f0bef2cb9a03', 'request_id': 'req-267e3287-5591-474f-a17a-937004f706b1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.995259 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] The token cache is being invalidate because project 136bb36ef1884d8fad68f0bef2cb9a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:37:42.995547 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.996164 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:37:42.997677 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1453/2908] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:37:42 2022] DELETE /identity/v3/projects/136bb36ef1884d8fad68f0bef2cb9a03 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:37:52.613494 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:52.991525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:54.347266 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:54.357107 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e51ceb-91e6-4ecb-a109-03c59433b676 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:54.408223 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:54.408864 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:54.409147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:54.409422 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:54.411160 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:54.421686 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:54.423125 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:54.432485 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1456/2909] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:37:55.515202 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:55.516758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:55.529300 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e3287-5591-474f-a17a-937004f706b1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:55.542527 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:55.543753 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:55.544192 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:55.544414 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:55.546510 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:55.623049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:55.624532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:55.635805 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1454/2910] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:37:55.711648 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:37:55.713077 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:55.790171 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3fa36-f934-4ce0-9a10-335a101f5529 service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:37:55.796073 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:37:55.796716 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:37:55.796996 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:37:55.797272 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:37:55.799063 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:37:55.810664 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:37:55.812265 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:37:55.822147 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1457/2911] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:37:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:38:05.630857 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=34 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:05.817838 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=58 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:07.421126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:38:07.422809 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:38:07.441177 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225bd36-644e-4d6f-9323-900f160ed8fe service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:38:07.449758 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:38:07.450368 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:38:07.451193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:38:07.451193 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:38:07.453124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:38:07.467910 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:38:07.469619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:38:07.488391 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1455/2912] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:38:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:38:17.476616 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:45.410131 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:45.411546 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:45.423931 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a5b70-a3fe-4f36-91c6-fc0406b1cbc7 service placement] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:45.427492 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:45.428238 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:45.428547 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:45.428818 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:45.430543 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:45.488671 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:45.490096 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:45.499291 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1458/2913] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:39:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:39:46.352071 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:46.367707 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8779b3-eb0b-4999-b6b9-92c44f31ca25 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:46.374126 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880e3ed0ab1641a3bdab9ff349d09286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:46.375011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:46.375011 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:46.375327 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:46.377110 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:46.391622 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:46.393249 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:46.405205 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1456/2914] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:39:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:39:48.560348 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:48.561957 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:48.580367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146b16-2b31-4de2-a526-05d2dbc8868c service neutron] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:48.586467 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:48.587180 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:48.587604 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:48.587941 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:48.589891 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:48.602913 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:48.604640 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:48.616878 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1459/2915] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:39:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:39:50.548804 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:50.558885 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b67cf0-ac40-4c53-8e53-66484e872a15 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:50.563525 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd37115dc7f468cb67bcb79af5e89e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:50.564183 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:50.564512 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:50.564766 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:50.566789 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:50.634406 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:50.635832 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:50.645589 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1457/2916] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:39:53.532342 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:53.545325 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130794a8-f6a7-4022-9a75-b53be4523fbc service placement] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:53.564384 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:53.565385 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:53.565822 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:53.566441 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:53.570285 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:53.603742 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:53.605541 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:53.619479 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1460/2917] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:39:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:39:56.739435 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:56.762273 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae29a5-a347-4c43-8298-95116b14a511 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:56.768218 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:56.772694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:56.772694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:56.772694 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:56.775025 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:56.789235 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:56.792536 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:56.804440 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1458/2918] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:39:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:39:56.820919 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:56.822367 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:56.836235 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dd802-45db-48ff-b517-52e24efb2a09 service placement] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:56.841859 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:56.842630 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:56.842907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:56.843730 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] PATH_INFO: `/v3/users/394b6f2e1978417fa6d7a74d74ef4268` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:56.844310 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394b6f2e1978417fa6d7a74d74ef4268)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:56.846274 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:56.916667 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394b6f2e1978417fa6d7a74d74ef4268'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:56.927907 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394b6f2e1978417fa6d7a74d74ef4268'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:56.936780 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394b6f2e1978417fa6d7a74d74ef4268'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:56.937395 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394b6f2e1978417fa6d7a74d74ef4268'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:56.944750 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394b6f2e1978417fa6d7a74d74ef4268'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:56.950670 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1461/2919] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:39:56 2022] DELETE /identity/v3/users/394b6f2e1978417fa6d7a74d74ef4268 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:39:57.181124 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:57.192629 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0ba63-8871-40c6-ab62-25177ba26484 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:57.260004 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:57.260687 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:57.260971 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:57.261248 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] PATH_INFO: `/v3/projects/29d3dfd9c8284c259e1893d6a3fc5207` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:57.262375 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d3dfd9c8284c259e1893d6a3fc5207)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:57.264620 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:57.329114 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d3dfd9c8284c259e1893d6a3fc5207', 'request_id': 'req-52e6d2a7-158f-4e3a-8425-3788bab3f552'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.337560 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d3dfd9c8284c259e1893d6a3fc5207', 'request_id': 'req-52e6d2a7-158f-4e3a-8425-3788bab3f552'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.345691 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d3dfd9c8284c259e1893d6a3fc5207', 'request_id': 'req-52e6d2a7-158f-4e3a-8425-3788bab3f552'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.355049 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:57.361000 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] The token cache is being invalidate because project 29d3dfd9c8284c259e1893d6a3fc5207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:39:57.361541 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.362838 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.365464 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1459/2920] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:39:57 2022] DELETE /identity/v3/projects/29d3dfd9c8284c259e1893d6a3fc5207 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:39:57.370532 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:57.371939 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:57.386718 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041be4-3b3b-4633-95b2-d8d3283ba764 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:57.432895 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:57.449528 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:57.450195 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:57.450523 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:57.450799 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] PATH_INFO: `/v3/users/ad78f08f086343029b6eb4799c0c2d73` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:57.451930 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad78f08f086343029b6eb4799c0c2d73)` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:57.453961 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:57.500132 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad78f08f086343029b6eb4799c0c2d73'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.511839 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad78f08f086343029b6eb4799c0c2d73'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.519287 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad78f08f086343029b6eb4799c0c2d73'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.519897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad78f08f086343029b6eb4799c0c2d73'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.527420 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.notifications [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad78f08f086343029b6eb4799c0c2d73'} {{(pid=81674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.533204 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1462/2921] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 17 19:39:57 2022] DELETE /identity/v3/users/ad78f08f086343029b6eb4799c0c2d73 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:39:57.711911 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:39:57.713437 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:39:57.731700 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6d2a7-158f-4e3a-8425-3788bab3f552 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:39:57.792357 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53f1ba3fed7453aacc3b6fcf0875642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fa6223fd0f04b6fb349808c655819e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:39:57.793040 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:39:57.793258 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:39:57.793532 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] PATH_INFO: `/v3/projects/42ef74347d6e402d9eb6d653884a22c9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:39:57.794643 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ef74347d6e402d9eb6d653884a22c9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:39:57.796619 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:39:57.842667 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ef74347d6e402d9eb6d653884a22c9', 'request_id': 'req-5216502d-87a6-467b-af19-e52799bcc778'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.848679 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ef74347d6e402d9eb6d653884a22c9', 'request_id': 'req-5216502d-87a6-467b-af19-e52799bcc778'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.854303 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ef74347d6e402d9eb6d653884a22c9', 'request_id': 'req-5216502d-87a6-467b-af19-e52799bcc778'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.866490 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] The token cache is being invalidate because project 42ef74347d6e402d9eb6d653884a22c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:39:57.866937 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.867569 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5216502d-87a6-467b-af19-e52799bcc778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:39:57.869133 dv-cinder-850698-2-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1460/2922] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 17 19:39:57 2022] DELETE /identity/v3/projects/42ef74347d6e402d9eb6d653884a22c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:40:07.529763 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:07.863347 dv-cinder-850698-2-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:56.336103 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Authenticating user token {{(pid=81674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:44:56.337834 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:44:56.479406 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f7ae-b2fb-41b1-a416-66b88973dc87 admin admin] Validating token access rules against request {{(pid=81674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:44:56.536796 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f02d8a6f8b462094e147547c7a1a2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a022669dd2f4cbba866b062924c7035', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:44:56.537398 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] REQUEST_METHOD: `GET` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:44:56.537672 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] SCRIPT_NAME: `/identity` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:44:56.537940 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:44:56.539650 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.fernet_utils [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:44:56.557593 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:44:56.559833 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e9b5f-f520-4056-be6f-e6923faadfcf service placement] RBAC: Authorization granted {{(pid=81674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:44:56.575967 dv-cinder-850698-2-smb devstack@keystone.service[81674]: [pid: 81674|app: 0|req: 1463/2923] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 17 19:44:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:45:06.568897 dv-cinder-850698-2-smb devstack@keystone.service[81674]: DEBUG dbcounter [-] [81674] Writing DB stats keystone:SELECT=89 {{(pid=81674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}